Command line
python /home/saxelrod/Repo/projects/chemprop/chemprop/train.py --config_path /home/saxelrod/chemprop_cov_2_gen/models/cp_auc/config.json --data_path /home/saxelrod/rgb_nfs/dsets/cov_2_gen/csv/train_full.csv --dataset_type classification
Args
{'activation': 'ReLU',
 'aggregation': 'mean',
 'aggregation_norm': 100,
 'atom_descriptors': None,
 'atom_descriptors_path': None,
 'atom_descriptors_size': 0,
 'atom_features_size': 0,
 'atom_messages': False,
 'batch_size': 50,
 'bias': False,
 'cache_cutoff': 10000,
 'checkpoint_dir': None,
 'checkpoint_path': None,
 'checkpoint_paths': None,
 'class_balance': True,
 'config_path': '/home/saxelrod/chemprop_cov_2_gen/models/cp_auc/config.json',
 'crossval_index_dir': None,
 'crossval_index_file': None,
 'crossval_index_sets': None,
 'cuda': True,
 'data_path': '/home/saxelrod/rgb_nfs/dsets/cov_2_gen/csv/train_full.csv',
 'dataset_type': 'classification',
 'depth': 5,
 'device': device(type='cuda', index=3),
 'dropout': 0.1,
 'ensemble_size': 1,
 'epochs': 2000,
 'extra_metrics': [],
 'features_generator': None,
 'features_only': False,
 'features_path': None,
 'features_scaling': False,
 'features_size': None,
 'ffn_hidden_size': 1200,
 'ffn_num_layers': 3,
 'final_lr': 0.0001,
 'folds_file': None,
 'gpu': 3,
 'grad_clip': None,
 'hidden_size': 1200,
 'ignore_columns': None,
 'init_lr': 0.0001,
 'log_frequency': 10,
 'max_data_size': None,
 'max_lr': 0.001,
 'metric': 'auc',
 'metrics': ['auc'],
 'minimize_score': False,
 'mpn_shared': False,
 'multiclass_num_classes': 3,
 'no_cache_mol': False,
 'no_cuda': False,
 'no_features_scaling': True,
 'num_folds': 10,
 'num_lrs': 1,
 'num_tasks': 1,
 'num_workers': 8,
 'number_of_molecules': 1,
 'pytorch_seed': 0,
 'quiet': True,
 'save_dir': '/home/saxelrod/chemprop_cov_2_gen/models/cp_auc',
 'save_preds': False,
 'save_smiles_splits': False,
 'seed': 0,
 'separate_test_features_path': None,
 'separate_test_path': '/home/saxelrod/rgb_nfs/dsets/cov_2_gen/csv/test_full.csv',
 'separate_val_features_path': None,
 'separate_val_path': '/home/saxelrod/rgb_nfs/dsets/cov_2_gen/csv/val_full.csv',
 'show_individual_scores': False,
 'smiles_columns': [None],
 'split_sizes': (0.8, 0.1, 0.1),
 'split_type': 'random',
 'target_columns': None,
 'task_names': ['sars_cov_two_active'],
 'test': False,
 'test_fold_index': None,
 'train_data_size': None,
 'undirected': False,
 'use_input_features': False,
 'val_fold_index': None,
 'warmup_epochs': 2.0}
Loading data
Number of tasks = 1
Fold 0
Splitting data with seed 0
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.627706
Epoch 1
Validation auc = 0.482834
Epoch 2
Validation auc = 0.737590
Epoch 3
Validation auc = 0.694238
Epoch 4
Loss = 6.8985e-01, PNorm = 71.6132, GNorm = 1.0606, lr_0 = 2.0385e-04
Loss = 7.1569e-01, PNorm = 71.6144, GNorm = 2.6495, lr_0 = 2.1077e-04
Validation auc = 0.650503
Epoch 5
Validation auc = 0.727805
Epoch 6
Validation auc = 0.555653
Epoch 7
Validation auc = 0.677236
Epoch 8
Validation auc = 0.717363
Epoch 9
Loss = 7.0914e-01, PNorm = 71.6380, GNorm = 1.0737, lr_0 = 3.0077e-04
Validation auc = 0.740105
Epoch 10
Validation auc = 0.722010
Epoch 11
Validation auc = 0.712552
Epoch 12
Validation auc = 0.730538
Epoch 13
Validation auc = 0.689318
Epoch 14
Loss = 6.7535e-01, PNorm = 71.6810, GNorm = 1.5971, lr_0 = 4.0462e-04
Validation auc = 0.706866
Epoch 15
Validation auc = 0.667450
Epoch 16
Validation auc = 0.659359
Epoch 17
Validation auc = 0.664826
Epoch 18
Loss = 6.8463e-01, PNorm = 71.7341, GNorm = 1.0721, lr_0 = 4.9462e-04
Loss = 5.5246e-01, PNorm = 71.7403, GNorm = 1.7624, lr_0 = 5.0154e-04
Validation auc = 0.631752
Epoch 19
Validation auc = 0.665154
Epoch 20
Validation auc = 0.621146
Epoch 21
Validation auc = 0.651432
Epoch 22
Validation auc = 0.613055
Epoch 23
Loss = 6.7874e-01, PNorm = 71.8053, GNorm = 1.0701, lr_0 = 5.9846e-04
Loss = 6.0923e-01, PNorm = 71.8100, GNorm = 1.5908, lr_0 = 6.0538e-04
Validation auc = 0.617155
Epoch 24
Validation auc = 0.620216
Epoch 25
Validation auc = 0.601957
Epoch 26
Validation auc = 0.621747
Epoch 27
Validation auc = 0.621146
Epoch 28
Loss = 6.4334e-01, PNorm = 71.8945, GNorm = 0.6319, lr_0 = 6.9538e-04
Validation auc = 0.628253
Epoch 29
Validation auc = 0.600208
Epoch 30
Validation auc = 0.594194
Epoch 31
Validation auc = 0.604636
Epoch 32
Validation auc = 0.616116
Epoch 33
Loss = 5.9690e-01, PNorm = 72.0298, GNorm = 0.5859, lr_0 = 7.9923e-04
Validation auc = 0.620380
Epoch 34
Validation auc = 0.614148
Epoch 35
Validation auc = 0.636562
Epoch 36
Validation auc = 0.625793
Epoch 37
Loss = 6.3493e-01, PNorm = 72.2096, GNorm = 0.8339, lr_0 = 8.8923e-04
Loss = 7.8783e-01, PNorm = 72.2235, GNorm = 0.8664, lr_0 = 8.9615e-04
Validation auc = 0.623497
Epoch 38
Validation auc = 0.623606
Epoch 39
Validation auc = 0.630440
Epoch 40
Validation auc = 0.632353
Epoch 41
Validation auc = 0.639187
Epoch 42
Loss = 5.9581e-01, PNorm = 72.4317, GNorm = 1.0631, lr_0 = 9.8615e-04
Validation auc = 0.632681
Epoch 43
Validation auc = 0.627925
Epoch 44
Validation auc = 0.615406
Epoch 45
Validation auc = 0.607315
Epoch 46
Validation auc = 0.610759
Epoch 47
Loss = 6.3026e-01, PNorm = 72.6623, GNorm = 0.2813, lr_0 = 9.9977e-04
Validation auc = 0.629893
Epoch 48
Validation auc = 0.630932
Epoch 49
Validation auc = 0.626066
Epoch 50
Validation auc = 0.614094
Epoch 51
Loss = 5.3587e-01, PNorm = 72.8653, GNorm = 0.7728, lr_0 = 9.9954e-04
Loss = 1.4640e-01, PNorm = 72.8863, GNorm = 0.7824, lr_0 = 9.9952e-04
Validation auc = 0.616608
Epoch 52
Validation auc = 0.617319
Epoch 53
Validation auc = 0.609392
Epoch 54
Validation auc = 0.620107
Epoch 55
Validation auc = 0.602887
Epoch 56
Loss = 5.8506e-01, PNorm = 73.1494, GNorm = 0.3184, lr_0 = 9.9927e-04
Loss = 5.9664e-01, PNorm = 73.1688, GNorm = 0.6928, lr_0 = 9.9926e-04
Validation auc = 0.585010
Epoch 57
Validation auc = 0.581894
Epoch 58
Validation auc = 0.579762
Epoch 59
Validation auc = 0.590203
Epoch 60
Validation auc = 0.578176
Epoch 61
Loss = 5.6428e-01, PNorm = 73.3961, GNorm = 0.7429, lr_0 = 9.9903e-04
Validation auc = 0.592827
Epoch 62
Validation auc = 0.598896
Epoch 63
Validation auc = 0.602777
Epoch 64
Validation auc = 0.620927
Epoch 65
Validation auc = 0.593155
Epoch 66
Loss = 7.0308e-01, PNorm = 73.6536, GNorm = 0.9686, lr_0 = 9.9876e-04
Validation auc = 0.522305
Epoch 67
Validation auc = 0.537175
Epoch 68
Validation auc = 0.578614
Epoch 69
Validation auc = 0.614531
Epoch 70
Loss = 6.1526e-01, PNorm = 73.8568, GNorm = 0.3619, lr_0 = 9.9853e-04
Loss = 4.2925e-01, PNorm = 73.8736, GNorm = 0.8028, lr_0 = 9.9851e-04
Validation auc = 0.621091
Epoch 71
Validation auc = 0.622677
Epoch 72
Validation auc = 0.622567
Epoch 73
Validation auc = 0.629784
Epoch 74
Validation auc = 0.643669
Epoch 75
Loss = 5.3933e-01, PNorm = 74.0787, GNorm = 0.7007, lr_0 = 9.9828e-04
Validation auc = 0.642576
Epoch 76
Validation auc = 0.627269
Epoch 77
Validation auc = 0.623005
Epoch 78
Validation auc = 0.622403
Epoch 79
Validation auc = 0.625191
Epoch 80
Loss = 6.1958e-01, PNorm = 74.4050, GNorm = 1.5725, lr_0 = 9.9802e-04
Validation auc = 0.661382
Epoch 81
Validation auc = 0.653455
Epoch 82
Validation auc = 0.646840
Epoch 83
Validation auc = 0.640663
Epoch 84
Loss = 6.3916e-01, PNorm = 74.7914, GNorm = 2.7680, lr_0 = 9.9779e-04
Loss = 1.5019e-01, PNorm = 74.8163, GNorm = 1.4377, lr_0 = 9.9777e-04
Validation auc = 0.643560
Epoch 85
Validation auc = 0.642904
Epoch 86
Validation auc = 0.650995
Epoch 87
Validation auc = 0.663787
Epoch 88
Validation auc = 0.658211
Epoch 89
Loss = 4.6630e-01, PNorm = 75.1249, GNorm = 0.3451, lr_0 = 9.9752e-04
Loss = 3.8266e-01, PNorm = 75.1447, GNorm = 0.4519, lr_0 = 9.9750e-04
Validation auc = 0.650503
Epoch 90
Validation auc = 0.655532
Epoch 91
Validation auc = 0.658211
Epoch 92
Validation auc = 0.645309
Epoch 93
Validation auc = 0.631533
Epoch 94
Loss = 4.5199e-01, PNorm = 75.4215, GNorm = 1.1625, lr_0 = 9.9727e-04
Validation auc = 0.642412
Epoch 95
Validation auc = 0.634813
Epoch 96
Validation auc = 0.647277
Epoch 97
Validation auc = 0.615187
Epoch 98
Validation auc = 0.619560
Epoch 99
Loss = 2.8039e-01, PNorm = 75.8007, GNorm = 0.8207, lr_0 = 9.9701e-04
Validation auc = 0.627487
Epoch 100
Validation auc = 0.645200
Epoch 101
Validation auc = 0.644817
Epoch 102
Validation auc = 0.641155
Epoch 103
Loss = 3.3344e-01, PNorm = 76.1426, GNorm = 0.9659, lr_0 = 9.9678e-04
Loss = 3.5682e-01, PNorm = 76.1707, GNorm = 1.8854, lr_0 = 9.9676e-04
Validation auc = 0.651542
Epoch 104
Validation auc = 0.639733
Epoch 105
Validation auc = 0.645965
Epoch 106
Validation auc = 0.667232
Epoch 107
Validation auc = 0.655368
Epoch 108
Loss = 2.1537e-01, PNorm = 76.5452, GNorm = 2.2328, lr_0 = 9.9651e-04
Validation auc = 0.660289
Epoch 109
Validation auc = 0.670129
Epoch 110
Validation auc = 0.667669
Epoch 111
Validation auc = 0.674175
Epoch 112
Validation auc = 0.661655
Epoch 113
Loss = 2.2194e-01, PNorm = 76.8942, GNorm = 0.9991, lr_0 = 9.9627e-04
Validation auc = 0.653072
Epoch 114
Validation auc = 0.637328
Epoch 115
Validation auc = 0.653291
Epoch 116
Validation auc = 0.682812
Epoch 117
Loss = 2.8351e-01, PNorm = 77.3007, GNorm = 1.1348, lr_0 = 9.9604e-04
Loss = 1.1809e-01, PNorm = 77.3406, GNorm = 1.5410, lr_0 = 9.9602e-04
Validation auc = 0.690520
Epoch 118
Validation auc = 0.696425
Epoch 119
Validation auc = 0.711732
Epoch 120
Validation auc = 0.694457
Epoch 121
Validation auc = 0.687732
Epoch 122
Loss = 2.9361e-01, PNorm = 77.7738, GNorm = 0.6300, lr_0 = 9.9577e-04
Loss = 6.3983e-01, PNorm = 77.7945, GNorm = 2.1185, lr_0 = 9.9575e-04
Validation auc = 0.671277
Epoch 123
Validation auc = 0.672097
Epoch 124
Validation auc = 0.677400
Epoch 125
Validation auc = 0.681172
Epoch 126
Validation auc = 0.676799
Epoch 127
Loss = 2.4106e-01, PNorm = 78.0802, GNorm = 0.9633, lr_0 = 9.9552e-04
Validation auc = 0.674721
Epoch 128
Validation auc = 0.657774
Epoch 129
Validation auc = 0.666248
Epoch 130
Validation auc = 0.683632
Epoch 131
Validation auc = 0.678603
Epoch 132
Loss = 4.0799e-01, PNorm = 78.4239, GNorm = 2.3664, lr_0 = 9.9526e-04
Validation auc = 0.659469
Epoch 133
Validation auc = 0.639296
Epoch 134
Validation auc = 0.631642
Epoch 135
Validation auc = 0.626503
Epoch 136
Loss = 2.3125e-01, PNorm = 78.7386, GNorm = 1.8839, lr_0 = 9.9503e-04
Loss = 1.0553e+00, PNorm = 78.7585, GNorm = 5.5000, lr_0 = 9.9501e-04
Validation auc = 0.628362
Epoch 137
Validation auc = 0.631260
Epoch 138
Validation auc = 0.653892
Epoch 139
Validation auc = 0.674885
Epoch 140
Validation auc = 0.678657
Epoch 141
Loss = 1.1711e-01, PNorm = 79.1207, GNorm = 0.9138, lr_0 = 9.9477e-04
Validation auc = 0.677673
Epoch 142
Validation auc = 0.677072
Epoch 143
Validation auc = 0.679587
Epoch 144
Validation auc = 0.671441
Epoch 145
Validation auc = 0.667997
Epoch 146
Loss = 1.0500e-01, PNorm = 79.4403, GNorm = 0.6454, lr_0 = 9.9452e-04
Validation auc = 0.657337
Epoch 147
Validation auc = 0.644271
Epoch 148
Validation auc = 0.651214
Epoch 149
Validation auc = 0.648152
Epoch 150
Loss = 3.5506e-01, PNorm = 79.7379, GNorm = 4.2398, lr_0 = 9.9429e-04
Loss = 1.6663e-02, PNorm = 79.7620, GNorm = 0.2888, lr_0 = 9.9427e-04
Validation auc = 0.656681
Epoch 151
Validation auc = 0.663432
Epoch 152
Validation auc = 0.658430
Epoch 153
Validation auc = 0.653127
Epoch 154
Validation auc = 0.663678
Epoch 155
Loss = 2.0188e-01, PNorm = 80.0271, GNorm = 0.9301, lr_0 = 9.9403e-04
Loss = 2.5237e-01, PNorm = 80.0453, GNorm = 3.7074, lr_0 = 9.9401e-04
Validation auc = 0.669090
Epoch 156
Validation auc = 0.670020
Epoch 157
Validation auc = 0.675815
Epoch 158
Validation auc = 0.680297
Epoch 159
Validation auc = 0.684124
Epoch 160
Loss = 8.2511e-02, PNorm = 80.2799, GNorm = 1.2971, lr_0 = 9.9378e-04
Validation auc = 0.677783
Epoch 161
Validation auc = 0.683468
Epoch 162
Validation auc = 0.664771
Epoch 163
Validation auc = 0.636289
Epoch 164
Validation auc = 0.627597
Epoch 165
Loss = 2.6939e-01, PNorm = 80.5534, GNorm = 1.5930, lr_0 = 9.9351e-04
Validation auc = 0.635633
Epoch 166
Validation auc = 0.649136
Epoch 167
Validation auc = 0.655860
Epoch 168
Validation auc = 0.673245
Epoch 169
Loss = 1.7831e-01, PNorm = 80.8252, GNorm = 3.7483, lr_0 = 9.9329e-04
Loss = 1.6972e-01, PNorm = 80.8493, GNorm = 8.3758, lr_0 = 9.9327e-04
Validation auc = 0.674065
Epoch 170
Validation auc = 0.650011
Epoch 171
Validation auc = 0.636781
Epoch 172
Validation auc = 0.625355
Epoch 173
Validation auc = 0.633938
Epoch 174
Loss = 1.7018e-01, PNorm = 81.1730, GNorm = 1.7442, lr_0 = 9.9302e-04
Validation auc = 0.651760
Epoch 175
Validation auc = 0.657227
Epoch 176
Validation auc = 0.668708
Epoch 177
Validation auc = 0.679587
Epoch 178
Validation auc = 0.685546
Epoch 179
Loss = 4.8898e-02, PNorm = 81.4301, GNorm = 0.8653, lr_0 = 9.9277e-04
Validation auc = 0.689044
Epoch 180
Validation auc = 0.691012
Epoch 181
Validation auc = 0.688443
Epoch 182
Validation auc = 0.688006
Epoch 183
Loss = 7.6862e-02, PNorm = 81.5985, GNorm = 0.2420, lr_0 = 9.9253e-04
Validation auc = 0.681008
Epoch 184
Validation auc = 0.676143
Epoch 185
Validation auc = 0.672042
Epoch 186
Validation auc = 0.662858
Epoch 187
Validation auc = 0.655314
Epoch 188
Loss = 1.0451e-01, PNorm = 81.7458, GNorm = 1.4520, lr_0 = 9.9228e-04
Loss = 7.5041e-01, PNorm = 81.7572, GNorm = 13.3863, lr_0 = 9.9226e-04
Validation auc = 0.643341
Epoch 189
Validation auc = 0.638202
Epoch 190
Validation auc = 0.636508
Epoch 191
Validation auc = 0.640717
Epoch 192
Validation auc = 0.636070
Epoch 193
Loss = 2.5509e-01, PNorm = 82.0525, GNorm = 1.8902, lr_0 = 9.9204e-04
Validation auc = 0.636125
Epoch 194
Validation auc = 0.652307
Epoch 195
Validation auc = 0.662038
Epoch 196
Validation auc = 0.665373
Epoch 197
Validation auc = 0.673737
Epoch 198
Loss = 1.0393e-01, PNorm = 82.3536, GNorm = 0.5047, lr_0 = 9.9177e-04
Validation auc = 0.677181
Epoch 199
Validation auc = 0.679969
Epoch 200
Validation auc = 0.677045
Epoch 201
Validation auc = 0.672015
Epoch 202
Loss = 1.0672e-01, PNorm = 82.5519, GNorm = 1.0531, lr_0 = 9.9154e-04
Loss = 1.3538e-02, PNorm = 82.5667, GNorm = 0.2632, lr_0 = 9.9153e-04
Validation auc = 0.670676
Epoch 203
Validation auc = 0.669418
Epoch 204
Validation auc = 0.668926
Epoch 205
Validation auc = 0.664717
Epoch 206
Validation auc = 0.658485
Epoch 207
Loss = 4.8006e-02, PNorm = 82.7500, GNorm = 1.3485, lr_0 = 9.9128e-04
Loss = 1.4296e-02, PNorm = 82.7609, GNorm = 0.2770, lr_0 = 9.9126e-04
Validation auc = 0.652580
Epoch 208
Validation auc = 0.652143
Epoch 209
Validation auc = 0.645473
Epoch 210
Validation auc = 0.652635
Epoch 211
Validation auc = 0.662967
Epoch 212
Loss = 2.1334e-02, PNorm = 82.9105, GNorm = 0.3482, lr_0 = 9.9103e-04
Validation auc = 0.663186
Epoch 213
Validation auc = 0.652963
Epoch 214
Validation auc = 0.641319
Epoch 215
Validation auc = 0.633064
Epoch 216
Loss = 2.3739e-01, PNorm = 83.0923, GNorm = 1.9825, lr_0 = 9.9079e-04
Validation auc = 0.637437
Epoch 217
Validation auc = 0.641209
Epoch 218
Validation auc = 0.644927
Epoch 219
Validation auc = 0.651651
Epoch 220
Validation auc = 0.658375
Epoch 221
Loss = 1.3846e-01, PNorm = 83.2901, GNorm = 1.0675, lr_0 = 9.9054e-04
Loss = 6.5418e-02, PNorm = 83.3017, GNorm = 1.5914, lr_0 = 9.9052e-04
Validation auc = 0.659523
Epoch 222
Validation auc = 0.657282
Epoch 223
Validation auc = 0.656899
Epoch 224
Validation auc = 0.655915
Epoch 225
Validation auc = 0.659086
Epoch 226
Loss = 1.4209e-01, PNorm = 83.5060, GNorm = 1.7206, lr_0 = 9.9030e-04
Validation auc = 0.667396
Epoch 227
Validation auc = 0.669801
Epoch 228
Validation auc = 0.655095
Epoch 229
Validation auc = 0.646895
Epoch 230
Validation auc = 0.643287
Epoch 231
Loss = 1.7553e-01, PNorm = 83.8154, GNorm = 1.4050, lr_0 = 9.9003e-04
Validation auc = 0.655368
Epoch 232
Validation auc = 0.665810
Epoch 233
Validation auc = 0.671168
Epoch 234
Validation auc = 0.670184
Epoch 235
Loss = 8.6406e-02, PNorm = 84.0943, GNorm = 0.5478, lr_0 = 9.8980e-04
Loss = 3.9075e-02, PNorm = 84.1145, GNorm = 0.4036, lr_0 = 9.8979e-04
Validation auc = 0.667778
Epoch 236
Validation auc = 0.662421
Epoch 237
Validation auc = 0.669801
Epoch 238
Validation auc = 0.657774
Epoch 239
Validation auc = 0.665209
Epoch 240
Loss = 1.4431e-01, PNorm = 84.3753, GNorm = 2.0136, lr_0 = 9.8954e-04
Loss = 3.2637e-02, PNorm = 84.3949, GNorm = 0.7087, lr_0 = 9.8952e-04
Validation auc = 0.658922
Epoch 241
Validation auc = 0.645309
Epoch 242
Validation auc = 0.640827
Epoch 243
Validation auc = 0.636453
Epoch 244
Validation auc = 0.629346
Epoch 245
Loss = 1.3429e-01, PNorm = 84.6211, GNorm = 1.0368, lr_0 = 9.8930e-04
Validation auc = 0.621037
Epoch 246
Validation auc = 0.610704
Epoch 247
Validation auc = 0.620545
Epoch 248
Validation auc = 0.621255
Epoch 249
Loss = 1.4600e-01, PNorm = 84.8239, GNorm = 0.4808, lr_0 = 9.8905e-04
Validation auc = 0.628198
Epoch 250
Validation auc = 0.637437
Epoch 251
Validation auc = 0.640936
Epoch 252
Validation auc = 0.644052
Epoch 253
Validation auc = 0.644599
Epoch 254
Loss = 4.5304e-02, PNorm = 84.9995, GNorm = 0.7982, lr_0 = 9.8880e-04
Loss = 2.3078e-01, PNorm = 85.0119, GNorm = 2.5919, lr_0 = 9.8879e-04
Validation auc = 0.638695
Epoch 255
Validation auc = 0.635305
Epoch 256
Validation auc = 0.634868
Epoch 257
Validation auc = 0.638421
Epoch 258
Validation auc = 0.645856
Epoch 259
Loss = 3.8870e-02, PNorm = 85.1607, GNorm = 1.7029, lr_0 = 9.8856e-04
Validation auc = 0.650995
Epoch 260
Validation auc = 0.649902
Epoch 261
Validation auc = 0.653674
Epoch 262
Validation auc = 0.657829
Epoch 263
Validation auc = 0.660562
Epoch 264
Loss = 1.0003e-01, PNorm = 85.2892, GNorm = 0.9056, lr_0 = 9.8830e-04
Validation auc = 0.662803
Epoch 265
Validation auc = 0.661054
Epoch 266
Validation auc = 0.656462
Epoch 267
Validation auc = 0.650831
Epoch 268
Loss = 1.1559e-02, PNorm = 85.3716, GNorm = 0.2265, lr_0 = 9.8807e-04
Loss = 1.2396e-02, PNorm = 85.3789, GNorm = 0.2539, lr_0 = 9.8805e-04
Validation auc = 0.647988
Epoch 269
Validation auc = 0.647496
Epoch 270
Validation auc = 0.649191
Epoch 271
Validation auc = 0.656954
Epoch 272
Validation auc = 0.667068
Epoch 273
Loss = 5.1745e-03, PNorm = 85.4529, GNorm = 0.1168, lr_0 = 9.8781e-04
Loss = 1.9022e-04, PNorm = 85.4580, GNorm = 0.0062, lr_0 = 9.8779e-04
Validation auc = 0.674010
Epoch 274
Validation auc = 0.678931
Epoch 275
Validation auc = 0.684070
Epoch 276
Validation auc = 0.686202
Epoch 277
Validation auc = 0.685764
Epoch 278
Loss = 4.3806e-03, PNorm = 85.5279, GNorm = 0.1620, lr_0 = 9.8756e-04
Validation auc = 0.685382
Epoch 279
Validation auc = 0.684288
Epoch 280
Validation auc = 0.678165
Epoch 281
Validation auc = 0.672261
Epoch 282
Validation auc = 0.671714
Epoch 283
Loss = 1.8942e-01, PNorm = 85.6029, GNorm = 1.6026, lr_0 = 9.8730e-04
Validation auc = 0.670621
Epoch 284
Validation auc = 0.676799
Epoch 285
Validation auc = 0.685218
Epoch 286
Validation auc = 0.691340
Epoch 287
Loss = 1.0730e-01, PNorm = 85.7296, GNorm = 0.7927, lr_0 = 9.8707e-04
Loss = 1.3491e-02, PNorm = 85.7416, GNorm = 0.1969, lr_0 = 9.8705e-04
Validation auc = 0.691504
Epoch 288
Validation auc = 0.692707
Epoch 289
Validation auc = 0.693637
Epoch 290
Validation auc = 0.695495
Epoch 291
Validation auc = 0.698721
Epoch 292
Loss = 2.1755e-02, PNorm = 85.8822, GNorm = 0.7971, lr_0 = 9.8683e-04
Validation auc = 0.700306
Epoch 293
Validation auc = 0.701181
Epoch 294
Validation auc = 0.704625
Epoch 295
Validation auc = 0.708670
Epoch 296
Validation auc = 0.708780
Epoch 297
Loss = 1.0201e-01, PNorm = 86.0195, GNorm = 0.7392, lr_0 = 9.8656e-04
Validation auc = 0.706702
Epoch 298
Validation auc = 0.705445
Epoch 299
Validation auc = 0.705390
Epoch 300
Validation auc = 0.702548
Epoch 301
Loss = 3.8469e-02, PNorm = 86.0962, GNorm = 1.6389, lr_0 = 9.8634e-04
Loss = 4.8545e-03, PNorm = 86.1008, GNorm = 0.2006, lr_0 = 9.8632e-04
Validation auc = 0.700361
Epoch 302
Validation auc = 0.698939
Epoch 303
Validation auc = 0.696151
Epoch 304
Validation auc = 0.701564
Epoch 305
Validation auc = 0.706429
Epoch 306
Loss = 8.1930e-02, PNorm = 86.1576, GNorm = 0.1336, lr_0 = 9.8607e-04
Loss = 5.1821e-04, PNorm = 86.1632, GNorm = 0.0128, lr_0 = 9.8606e-04
Validation auc = 0.708288
Epoch 307
Validation auc = 0.708889
Epoch 308
Validation auc = 0.707468
Epoch 309
Validation auc = 0.698557
Epoch 310
Validation auc = 0.689591
Epoch 311
Loss = 2.7080e-01, PNorm = 86.2715, GNorm = 3.3456, lr_0 = 9.8583e-04
Validation auc = 0.698010
Epoch 312
Validation auc = 0.692926
Epoch 313
Validation auc = 0.690356
Epoch 314
Validation auc = 0.689482
Epoch 315
Validation auc = 0.687350
Epoch 316
Loss = 7.4012e-02, PNorm = 86.4270, GNorm = 0.9986, lr_0 = 9.8557e-04
Validation auc = 0.689482
Epoch 317
Validation auc = 0.686256
Epoch 318
Validation auc = 0.681117
Epoch 319
Validation auc = 0.678657
Epoch 320
Loss = 5.3582e-02, PNorm = 86.5748, GNorm = 1.0666, lr_0 = 9.8534e-04
Loss = 1.9321e-02, PNorm = 86.5869, GNorm = 0.5851, lr_0 = 9.8532e-04
Validation auc = 0.671988
Epoch 321
Validation auc = 0.667013
Epoch 322
Validation auc = 0.664443
Epoch 323
Validation auc = 0.663077
Epoch 324
Validation auc = 0.666904
Epoch 325
Loss = 9.4611e-03, PNorm = 86.7169, GNorm = 0.2365, lr_0 = 9.8509e-04
Validation auc = 0.668926
Epoch 326
Validation auc = 0.676033
Epoch 327
Validation auc = 0.680297
Epoch 328
Validation auc = 0.677837
Epoch 329
Validation auc = 0.675541
Epoch 330
Loss = 2.6599e-02, PNorm = 86.8083, GNorm = 1.1707, lr_0 = 9.8483e-04
Validation auc = 0.678603
Epoch 331
Validation auc = 0.682976
Epoch 332
Validation auc = 0.686147
Epoch 333
Validation auc = 0.686530
Epoch 334
Loss = 6.3943e-03, PNorm = 86.8735, GNorm = 0.1089, lr_0 = 9.8461e-04
Loss = 1.7392e-03, PNorm = 86.8782, GNorm = 0.0447, lr_0 = 9.8459e-04
Validation auc = 0.687623
Epoch 335
Validation auc = 0.688443
Epoch 336
Validation auc = 0.691997
Epoch 337
Validation auc = 0.698557
Epoch 338
Validation auc = 0.698666
Epoch 339
Loss = 6.3449e-02, PNorm = 86.9251, GNorm = 3.8244, lr_0 = 9.8434e-04
Loss = 1.5417e+00, PNorm = 86.9204, GNorm = 10.8689, lr_0 = 9.8433e-04
Validation auc = 0.697026
Epoch 340
Validation auc = 0.708670
Epoch 341
Validation auc = 0.716379
Epoch 342
Validation auc = 0.716816
Epoch 343
Validation auc = 0.719276
Epoch 344
Loss = 6.5277e-02, PNorm = 87.0349, GNorm = 1.1408, lr_0 = 9.8410e-04
Validation auc = 0.720916
Epoch 345
Validation auc = 0.716816
Epoch 346
Validation auc = 0.710037
Epoch 347
Validation auc = 0.700853
Epoch 348
Validation auc = 0.697409
Epoch 349
Loss = 6.0762e-02, PNorm = 87.2718, GNorm = 0.7937, lr_0 = 9.8384e-04
Validation auc = 0.700743
Epoch 350
Validation auc = 0.704844
Epoch 351
Validation auc = 0.706921
Epoch 352
Validation auc = 0.707140
Epoch 353
Loss = 1.3523e-01, PNorm = 87.4098, GNorm = 0.6948, lr_0 = 9.8361e-04
Loss = 2.2047e-03, PNorm = 87.4174, GNorm = 0.0440, lr_0 = 9.8359e-04
Validation auc = 0.707960
Epoch 354
Validation auc = 0.708670
Epoch 355
Validation auc = 0.705718
Epoch 356
Validation auc = 0.709873
Epoch 357
Validation auc = 0.710967
Epoch 358
Loss = 7.2118e-02, PNorm = 87.5135, GNorm = 0.4251, lr_0 = 9.8335e-04
Validation auc = 0.715559
Epoch 359
Validation auc = 0.716871
Epoch 360
Validation auc = 0.722064
Epoch 361
Validation auc = 0.726656
Epoch 362
Validation auc = 0.728187
Epoch 363
Loss = 7.2343e-04, PNorm = 87.6024, GNorm = 0.0100, lr_0 = 9.8311e-04
Validation auc = 0.730647
Epoch 364
Validation auc = 0.732397
Epoch 365
Validation auc = 0.731577
Epoch 366
Validation auc = 0.729062
Epoch 367
Loss = 2.3700e-02, PNorm = 87.7219, GNorm = 1.3381, lr_0 = 9.8288e-04
Loss = 9.8344e-03, PNorm = 87.7329, GNorm = 0.2275, lr_0 = 9.8286e-04
Validation auc = 0.727695
Epoch 368
Validation auc = 0.727805
Epoch 369
Validation auc = 0.728570
Epoch 370
Validation auc = 0.732615
Epoch 371
Validation auc = 0.713044
Epoch 372
Loss = 1.2664e-02, PNorm = 87.8974, GNorm = 0.2195, lr_0 = 9.8262e-04
Loss = 5.3217e-03, PNorm = 87.9104, GNorm = 0.1572, lr_0 = 9.8260e-04
Validation auc = 0.702712
Epoch 373
Validation auc = 0.697682
Epoch 374
Validation auc = 0.698611
Epoch 375
Validation auc = 0.700415
Epoch 376
Validation auc = 0.709818
Epoch 377
Loss = 6.6838e-02, PNorm = 88.0338, GNorm = 0.9080, lr_0 = 9.8237e-04
Validation auc = 0.714301
Epoch 378
Validation auc = 0.715067
Epoch 379
Validation auc = 0.713427
Epoch 380
Validation auc = 0.711240
Epoch 381
Validation auc = 0.710748
Epoch 382
Loss = 8.1406e-03, PNorm = 88.1142, GNorm = 0.1810, lr_0 = 9.8211e-04
Validation auc = 0.710967
Epoch 383
Validation auc = 0.710803
Epoch 384
Validation auc = 0.710365
Epoch 385
Validation auc = 0.709545
Epoch 386
Loss = 6.0968e-03, PNorm = 88.1632, GNorm = 0.2190, lr_0 = 9.8189e-04
Loss = 3.8177e-03, PNorm = 88.1667, GNorm = 0.0648, lr_0 = 9.8187e-04
Validation auc = 0.708616
Epoch 387
Validation auc = 0.707577
Epoch 388
Validation auc = 0.706921
Epoch 389
Validation auc = 0.705172
Epoch 390
Validation auc = 0.705281
Epoch 391
Loss = 2.4292e-03, PNorm = 88.2189, GNorm = 0.0274, lr_0 = 9.8163e-04
Validation auc = 0.704570
Epoch 392
Validation auc = 0.704352
Epoch 393
Validation auc = 0.703696
Epoch 394
Validation auc = 0.708069
Epoch 395
Validation auc = 0.702438
Epoch 396
Loss = 8.4729e-03, PNorm = 88.2801, GNorm = 0.1067, lr_0 = 9.8138e-04
Validation auc = 0.700743
Epoch 397
Validation auc = 0.689564
Epoch 398
Validation auc = 0.668270
Epoch 399
Validation auc = 0.653783
Epoch 400
Loss = 5.0265e-02, PNorm = 88.4214, GNorm = 0.7331, lr_0 = 9.8116e-04
Loss = 1.8801e-03, PNorm = 88.4314, GNorm = 0.0501, lr_0 = 9.8114e-04
Validation auc = 0.648535
Epoch 401
Validation auc = 0.644599
Epoch 402
Validation auc = 0.644216
Epoch 403
Validation auc = 0.642631
Epoch 404
Validation auc = 0.645419
Epoch 405
Loss = 4.9948e-02, PNorm = 88.5539, GNorm = 0.7126, lr_0 = 9.8089e-04
Loss = 5.7897e-03, PNorm = 88.5627, GNorm = 0.1150, lr_0 = 9.8088e-04
Validation auc = 0.657610
Epoch 406
Validation auc = 0.664935
Epoch 407
Validation auc = 0.673081
Epoch 408
Validation auc = 0.677947
Epoch 409
Validation auc = 0.682211
Epoch 410
Loss = 5.1562e-03, PNorm = 88.6696, GNorm = 0.0650, lr_0 = 9.8065e-04
Validation auc = 0.684070
Epoch 411
Validation auc = 0.685928
Epoch 412
Validation auc = 0.687623
Epoch 413
Validation auc = 0.688388
Epoch 414
Validation auc = 0.689864
Epoch 415
Loss = 4.4650e-02, PNorm = 88.7312, GNorm = 0.7319, lr_0 = 9.8039e-04
Validation auc = 0.692762
Epoch 416
Validation auc = 0.693746
Epoch 417
Validation auc = 0.692871
Epoch 418
Validation auc = 0.692051
Epoch 419
Loss = 3.2849e-03, PNorm = 88.7715, GNorm = 0.0400, lr_0 = 9.8016e-04
Loss = 1.5423e-03, PNorm = 88.7745, GNorm = 0.0342, lr_0 = 9.8015e-04
Validation auc = 0.691559
Epoch 420
Validation auc = 0.691231
Epoch 421
Validation auc = 0.689919
Epoch 422
Validation auc = 0.689974
Epoch 423
Validation auc = 0.690192
Epoch 424
Loss = 5.1462e-02, PNorm = 88.8081, GNorm = 0.0253, lr_0 = 9.7990e-04
Validation auc = 0.689208
Epoch 425
Validation auc = 0.684835
Epoch 426
Validation auc = 0.685081
Epoch 427
Validation auc = 0.684343
Epoch 428
Validation auc = 0.688443
Epoch 429
Loss = 1.1057e-03, PNorm = 88.8438, GNorm = 0.0289, lr_0 = 9.7966e-04
Validation auc = 0.688443
Epoch 430
Validation auc = 0.688716
Epoch 431
Validation auc = 0.688607
Epoch 432
Validation auc = 0.689427
Epoch 433
Loss = 8.6708e-04, PNorm = 88.8770, GNorm = 0.0303, lr_0 = 9.7942e-04
Validation auc = 0.690028
Epoch 434
Validation auc = 0.690466
Epoch 435
Validation auc = 0.689864
Epoch 436
Validation auc = 0.688771
Epoch 437
Validation auc = 0.688607
Epoch 438
Loss = 3.3109e-03, PNorm = 88.8978, GNorm = 0.0225, lr_0 = 9.7917e-04
Loss = 7.5512e-05, PNorm = 88.8992, GNorm = 0.0026, lr_0 = 9.7916e-04
Validation auc = 0.688006
Epoch 439
Validation auc = 0.687623
Epoch 440
Validation auc = 0.688006
Epoch 441
Validation auc = 0.687951
Epoch 442
Validation auc = 0.688443
Epoch 443
Loss = 1.3447e-03, PNorm = 88.9183, GNorm = 0.0290, lr_0 = 9.7893e-04
Validation auc = 0.687623
Epoch 444
Validation auc = 0.685382
Epoch 445
Validation auc = 0.683687
Epoch 446
Validation auc = 0.679532
Epoch 447
Validation auc = 0.678439
Epoch 448
Loss = 8.1037e-03, PNorm = 88.9446, GNorm = 0.3818, lr_0 = 9.7867e-04
Validation auc = 0.679149
Epoch 449
Validation auc = 0.674995
Epoch 450
Validation auc = 0.675213
Epoch 451
Validation auc = 0.674612
Epoch 452
Loss = 1.2967e-01, PNorm = 88.9762, GNorm = 1.6675, lr_0 = 9.7845e-04
Loss = 1.3160e-03, PNorm = 88.9784, GNorm = 0.0275, lr_0 = 9.7843e-04
Validation auc = 0.676471
Epoch 453
Validation auc = 0.676799
Epoch 454
Validation auc = 0.679149
Epoch 455
Validation auc = 0.681828
Epoch 456
Validation auc = 0.682703
Epoch 457
Loss = 4.1307e-03, PNorm = 89.0277, GNorm = 0.0378, lr_0 = 9.7819e-04
Loss = 1.9760e-03, PNorm = 89.0333, GNorm = 0.0541, lr_0 = 9.7817e-04
Validation auc = 0.684507
Epoch 458
Validation auc = 0.683632
Epoch 459
Validation auc = 0.682375
Epoch 460
Validation auc = 0.682375
Epoch 461
Validation auc = 0.682539
Epoch 462
Loss = 8.7704e-03, PNorm = 89.0927, GNorm = 0.3620, lr_0 = 9.7794e-04
Validation auc = 0.680407
Epoch 463
Validation auc = 0.678712
Epoch 464
Validation auc = 0.677181
Epoch 465
Validation auc = 0.677127
Epoch 466
Loss = 1.2409e-02, PNorm = 89.1386, GNorm = 0.9574, lr_0 = 9.7770e-04
Validation auc = 0.676635
Epoch 467
Validation auc = 0.675869
Epoch 468
Validation auc = 0.675541
Epoch 469
Validation auc = 0.677455
Epoch 470
Validation auc = 0.681117
Epoch 471
Loss = 7.7602e-03, PNorm = 89.1726, GNorm = 0.4377, lr_0 = 9.7746e-04
Loss = 2.0252e-03, PNorm = 89.1765, GNorm = 0.0899, lr_0 = 9.7744e-04
Validation auc = 0.684780
Epoch 472
Validation auc = 0.687131
Epoch 473
Validation auc = 0.688826
Epoch 474
Validation auc = 0.692653
Epoch 475
Validation auc = 0.694347
Epoch 476
Loss = 1.0089e-03, PNorm = 89.2200, GNorm = 0.0167, lr_0 = 9.7721e-04
Validation auc = 0.695331
Epoch 477
Validation auc = 0.695222
Epoch 478
Validation auc = 0.693801
Epoch 479
Validation auc = 0.693527
Epoch 480
Validation auc = 0.693254
Epoch 481
Loss = 8.1493e-03, PNorm = 89.2557, GNorm = 0.2650, lr_0 = 9.7695e-04
Validation auc = 0.692543
Epoch 482
Validation auc = 0.689919
Epoch 483
Validation auc = 0.688388
Epoch 484
Validation auc = 0.687842
Epoch 485
Loss = 5.1361e-03, PNorm = 89.3004, GNorm = 0.6652, lr_0 = 9.7673e-04
Loss = 8.7528e-01, PNorm = 89.2982, GNorm = 8.4127, lr_0 = 9.7671e-04
Validation auc = 0.685600
Epoch 486
Validation auc = 0.684999
Epoch 487
Validation auc = 0.682047
Epoch 488
Validation auc = 0.677236
Epoch 489
Validation auc = 0.671769
Epoch 490
Loss = 1.3817e-02, PNorm = 89.3698, GNorm = 0.0729, lr_0 = 9.7647e-04
Loss = 4.6750e-03, PNorm = 89.3771, GNorm = 0.0786, lr_0 = 9.7645e-04
Validation auc = 0.669309
Epoch 491
Validation auc = 0.669582
Epoch 492
Validation auc = 0.671878
Epoch 493
Validation auc = 0.672589
Epoch 494
Validation auc = 0.674010
Epoch 495
Loss = 6.4528e-02, PNorm = 89.4564, GNorm = 0.5298, lr_0 = 9.7623e-04
Validation auc = 0.673026
Epoch 496
Validation auc = 0.674229
Epoch 497
Validation auc = 0.670840
Epoch 498
Validation auc = 0.668106
Epoch 499
Loss = 2.0022e-02, PNorm = 89.5467, GNorm = 0.2344, lr_0 = 9.7599e-04
Validation auc = 0.668052
Epoch 500
Validation auc = 0.670348
Epoch 501
Validation auc = 0.671222
Epoch 502
Validation auc = 0.673136
Epoch 503
Validation auc = 0.675487
Epoch 504
Loss = 4.2756e-03, PNorm = 89.6538, GNorm = 0.1717, lr_0 = 9.7574e-04
Loss = 1.1044e-03, PNorm = 89.6620, GNorm = 0.0226, lr_0 = 9.7573e-04
Validation auc = 0.677728
Epoch 505
Validation auc = 0.682156
Epoch 506
Validation auc = 0.687678
Epoch 507
Validation auc = 0.689044
Epoch 508
Validation auc = 0.693090
Epoch 509
Loss = 3.0854e-02, PNorm = 89.7528, GNorm = 0.7517, lr_0 = 9.7550e-04
Validation auc = 0.697901
Epoch 510
Validation auc = 0.698119
Epoch 511
Validation auc = 0.698830
Epoch 512
Validation auc = 0.699595
Epoch 513
Validation auc = 0.700142
Epoch 514
Loss = 4.4410e-02, PNorm = 89.8495, GNorm = 1.6593, lr_0 = 9.7524e-04
Validation auc = 0.699650
Epoch 515
Validation auc = 0.703258
Epoch 516
Validation auc = 0.711076
Epoch 517
Validation auc = 0.705937
Epoch 518
Loss = 9.9103e-02, PNorm = 89.9710, GNorm = 1.2467, lr_0 = 9.7502e-04
Loss = 1.4277e-02, PNorm = 89.9887, GNorm = 0.6701, lr_0 = 9.7500e-04
Validation auc = 0.696151
Epoch 519
Validation auc = 0.696042
Epoch 520
Validation auc = 0.703750
Epoch 521
Validation auc = 0.708780
Epoch 522
Validation auc = 0.707304
Epoch 523
Loss = 4.9515e-02, PNorm = 90.2285, GNorm = 1.1063, lr_0 = 9.7476e-04
Loss = 6.5938e-02, PNorm = 90.2453, GNorm = 0.8073, lr_0 = 9.7474e-04
Validation auc = 0.704680
Epoch 524
Validation auc = 0.703586
Epoch 525
Validation auc = 0.702274
Epoch 526
Validation auc = 0.700525
Epoch 527
Validation auc = 0.699650
Epoch 528
Loss = 2.3579e-02, PNorm = 90.4203, GNorm = 0.6573, lr_0 = 9.7452e-04
Validation auc = 0.700470
Epoch 529
Validation auc = 0.703805
Epoch 530
Validation auc = 0.704516
Epoch 531
Validation auc = 0.704352
Epoch 532
Validation auc = 0.705336
Epoch 533
Loss = 1.3126e-02, PNorm = 90.5533, GNorm = 0.2102, lr_0 = 9.7426e-04
Validation auc = 0.703586
Epoch 534
Validation auc = 0.710201
Epoch 535
Validation auc = 0.731686
Epoch 536
Validation auc = 0.731085
Epoch 537
Loss = 1.0751e-01, PNorm = 90.6697, GNorm = 0.7601, lr_0 = 9.7403e-04
Loss = 1.0628e-01, PNorm = 90.6795, GNorm = 1.7374, lr_0 = 9.7401e-04
Validation auc = 0.708998
Epoch 538
Validation auc = 0.702493
Epoch 539
Validation auc = 0.700197
Epoch 540
Validation auc = 0.701017
Epoch 541
Validation auc = 0.701564
Epoch 542
Loss = 3.6617e-02, PNorm = 90.8677, GNorm = 0.4154, lr_0 = 9.7379e-04
Validation auc = 0.706757
Epoch 543
Validation auc = 0.711623
Epoch 544
Validation auc = 0.712279
Epoch 545
Validation auc = 0.713427
Epoch 546
Validation auc = 0.715340
Epoch 547
Loss = 5.4422e-02, PNorm = 91.0739, GNorm = 0.3081, lr_0 = 9.7353e-04
Validation auc = 0.717964
Epoch 548
Validation auc = 0.719932
Epoch 549
Validation auc = 0.720479
Epoch 550
Validation auc = 0.721736
Epoch 551
Loss = 1.1919e-02, PNorm = 91.2406, GNorm = 0.5687, lr_0 = 9.7331e-04
Loss = 5.4869e-04, PNorm = 91.2518, GNorm = 0.0107, lr_0 = 9.7329e-04
Validation auc = 0.723978
Epoch 552
Validation auc = 0.726055
Epoch 553
Validation auc = 0.727586
Epoch 554
Validation auc = 0.725672
Epoch 555
Validation auc = 0.723376
Epoch 556
Loss = 3.6402e-03, PNorm = 91.3757, GNorm = 0.4076, lr_0 = 9.7305e-04
Loss = 9.3605e-03, PNorm = 91.3839, GNorm = 0.5069, lr_0 = 9.7303e-04
Validation auc = 0.722502
Epoch 557
Validation auc = 0.720096
Epoch 558
Validation auc = 0.718237
Epoch 559
Validation auc = 0.717308
Epoch 560
Validation auc = 0.716925
Epoch 561
Loss = 1.7287e-02, PNorm = 91.4573, GNorm = 0.7616, lr_0 = 9.7281e-04
Validation auc = 0.715996
Epoch 562
Validation auc = 0.716433
Epoch 563
Validation auc = 0.716379
Epoch 564
Validation auc = 0.716215
Epoch 565
Validation auc = 0.717199
Epoch 566
Loss = 1.3655e-03, PNorm = 91.5135, GNorm = 0.0216, lr_0 = 9.7255e-04
Validation auc = 0.717199
Epoch 567
Validation auc = 0.716925
Epoch 568
Validation auc = 0.715559
Epoch 569
Validation auc = 0.713153
Epoch 570
Loss = 4.9968e-03, PNorm = 91.5390, GNorm = 0.0469, lr_0 = 9.7232e-04
Loss = 1.5772e-03, PNorm = 91.5419, GNorm = 0.0493, lr_0 = 9.7231e-04
Validation auc = 0.711404
Epoch 571
Validation auc = 0.709108
Epoch 572
Validation auc = 0.707796
Epoch 573
Validation auc = 0.704133
Epoch 574
Validation auc = 0.699705
Epoch 575
Loss = 7.4424e-02, PNorm = 91.5784, GNorm = 1.0551, lr_0 = 9.7208e-04
Validation auc = 0.697081
Epoch 576
Validation auc = 0.694839
Epoch 577
Validation auc = 0.694675
Epoch 578
Validation auc = 0.695933
Epoch 579
Validation auc = 0.697409
Epoch 580
Loss = 7.0495e-04, PNorm = 91.6208, GNorm = 0.0154, lr_0 = 9.7182e-04
Validation auc = 0.698283
Epoch 581
Validation auc = 0.700470
Epoch 582
Validation auc = 0.700033
Epoch 583
Validation auc = 0.698229
Epoch 584
Loss = 2.2773e-01, PNorm = 91.7412, GNorm = 0.4200, lr_0 = 9.7160e-04
Loss = 1.5734e-02, PNorm = 91.7885, GNorm = 1.4966, lr_0 = 9.7158e-04
Validation auc = 0.714247
Epoch 585
Validation auc = 0.730046
Epoch 586
Validation auc = 0.736989
Epoch 587
Validation auc = 0.733107
Epoch 588
Validation auc = 0.725126
Epoch 589
Loss = 1.4719e-01, PNorm = 92.4628, GNorm = 1.1095, lr_0 = 9.7134e-04
Loss = 1.8894e+00, PNorm = 92.4980, GNorm = 22.1358, lr_0 = 9.7132e-04
Validation auc = 0.695113
Epoch 590
Validation auc = 0.720260
Epoch 591
Validation auc = 0.745353
Epoch 592
Validation auc = 0.732178
Epoch 593
Validation auc = 0.722502
Epoch 594
Loss = 2.8019e-01, PNorm = 93.0588, GNorm = 1.0208, lr_0 = 9.7110e-04
Validation auc = 0.706101
Epoch 595
Validation auc = 0.700361
Epoch 596
Validation auc = 0.703532
Epoch 597
Validation auc = 0.710037
Epoch 598
Validation auc = 0.714793
Epoch 599
Loss = 3.8361e-01, PNorm = 93.6220, GNorm = 2.8393, lr_0 = 9.7084e-04
Validation auc = 0.722556
Epoch 600
Validation auc = 0.725891
Epoch 601
Validation auc = 0.734529
Epoch 602
Validation auc = 0.706702
Epoch 603
Loss = 1.3859e-01, PNorm = 93.8606, GNorm = 1.3757, lr_0 = 9.7062e-04
Loss = 2.7438e-02, PNorm = 93.8768, GNorm = 0.9501, lr_0 = 9.7060e-04
Validation auc = 0.706210
Epoch 604
Validation auc = 0.710639
Epoch 605
Validation auc = 0.711240
Epoch 606
Validation auc = 0.715176
Epoch 607
Validation auc = 0.715668
Epoch 608
Loss = 2.0468e-02, PNorm = 94.1437, GNorm = 0.2393, lr_0 = 9.7036e-04
Validation auc = 0.715941
Epoch 609
Validation auc = 0.725399
Epoch 610
Validation auc = 0.722611
Epoch 611
Validation auc = 0.722228
Epoch 612
Validation auc = 0.724743
Epoch 613
Loss = 1.0881e-02, PNorm = 94.3528, GNorm = 0.6108, lr_0 = 9.7012e-04
Validation auc = 0.726219
Epoch 614
Validation auc = 0.726492
Epoch 615
Validation auc = 0.725508
Epoch 616
Validation auc = 0.735130
Epoch 617
Loss = 3.3270e-03, PNorm = 94.5025, GNorm = 0.0789, lr_0 = 9.6990e-04
Loss = 8.5724e-02, PNorm = 94.5148, GNorm = 4.3569, lr_0 = 9.6988e-04
Validation auc = 0.740706
Epoch 618
Validation auc = 0.737700
Epoch 619
Validation auc = 0.728133
Epoch 620
Validation auc = 0.727640
Epoch 621
Validation auc = 0.727476
Epoch 622
Loss = 5.6922e-02, PNorm = 94.7119, GNorm = 1.0925, lr_0 = 9.6964e-04
Loss = 1.3688e-02, PNorm = 94.7279, GNorm = 0.2908, lr_0 = 9.6962e-04
Validation auc = 0.729335
Epoch 623
Validation auc = 0.726110
Epoch 624
Validation auc = 0.727367
Epoch 625
Validation auc = 0.728078
Epoch 626
Validation auc = 0.722502
Epoch 627
Loss = 4.4678e-02, PNorm = 94.9489, GNorm = 0.4502, lr_0 = 9.6940e-04
Validation auc = 0.716980
Epoch 628
Validation auc = 0.714411
Epoch 629
Validation auc = 0.714356
Epoch 630
Validation auc = 0.712989
Epoch 631
Validation auc = 0.711677
Epoch 632
Loss = 1.1927e-02, PNorm = 95.1450, GNorm = 0.5613, lr_0 = 9.6914e-04
Validation auc = 0.709600
Epoch 633
Validation auc = 0.708069
Epoch 634
Validation auc = 0.705937
Epoch 635
Validation auc = 0.702712
Epoch 636
Loss = 1.4786e-02, PNorm = 95.2593, GNorm = 0.2799, lr_0 = 9.6892e-04
Loss = 5.1807e-03, PNorm = 95.2671, GNorm = 0.2338, lr_0 = 9.6890e-04
Validation auc = 0.700908
Epoch 637
Validation auc = 0.704625
Epoch 638
Validation auc = 0.707850
Epoch 639
Validation auc = 0.706593
Epoch 640
Validation auc = 0.706210
Epoch 641
Loss = 5.8928e-02, PNorm = 95.3608, GNorm = 0.7881, lr_0 = 9.6866e-04
Validation auc = 0.706429
Epoch 642
Validation auc = 0.707522
Epoch 643
Validation auc = 0.706374
Epoch 644
Validation auc = 0.700087
Epoch 645
Validation auc = 0.694511
Epoch 646
Loss = 1.7828e-02, PNorm = 95.4754, GNorm = 1.0089, lr_0 = 9.6842e-04
Validation auc = 0.698447
Epoch 647
Validation auc = 0.700470
Epoch 648
Validation auc = 0.709654
Epoch 649
Validation auc = 0.708124
Epoch 650
Loss = 4.3475e-02, PNorm = 95.5843, GNorm = 1.5048, lr_0 = 9.6820e-04
Loss = 5.5503e-02, PNorm = 95.5950, GNorm = 1.6255, lr_0 = 9.6818e-04
Validation auc = 0.703258
Epoch 651
Validation auc = 0.697409
Epoch 652
Validation auc = 0.694293
Epoch 653
Validation auc = 0.691723
Epoch 654
Validation auc = 0.695659
Epoch 655
Loss = 3.8562e-03, PNorm = 95.7466, GNorm = 0.1453, lr_0 = 9.6794e-04
Loss = 3.9047e-03, PNorm = 95.7570, GNorm = 0.1470, lr_0 = 9.6792e-04
Validation auc = 0.705937
Epoch 656
Validation auc = 0.712989
Epoch 657
Validation auc = 0.716543
Epoch 658
Validation auc = 0.726110
Epoch 659
Validation auc = 0.730757
Epoch 660
Loss = 2.7110e-03, PNorm = 95.8683, GNorm = 0.0933, lr_0 = 9.6770e-04
Validation auc = 0.730210
Epoch 661
Validation auc = 0.728351
Epoch 662
Validation auc = 0.736278
Epoch 663
Validation auc = 0.742346
Epoch 664
Validation auc = 0.737481
Epoch 665
Loss = 1.7141e-01, PNorm = 95.9700, GNorm = 1.4048, lr_0 = 9.6744e-04
Validation auc = 0.730483
Epoch 666
Validation auc = 0.728843
Epoch 667
Validation auc = 0.726656
Epoch 668
Validation auc = 0.723704
Epoch 669
Loss = 1.9836e-02, PNorm = 96.0466, GNorm = 0.6162, lr_0 = 9.6722e-04
Loss = 4.9940e-03, PNorm = 96.0527, GNorm = 0.0920, lr_0 = 9.6720e-04
Validation auc = 0.719659
Epoch 670
Validation auc = 0.717035
Epoch 671
Validation auc = 0.716051
Epoch 672
Validation auc = 0.715121
Epoch 673
Validation auc = 0.714137
Epoch 674
Loss = 4.5316e-03, PNorm = 96.1178, GNorm = 0.0519, lr_0 = 9.6696e-04
Validation auc = 0.713645
Epoch 675
Validation auc = 0.712333
Epoch 676
Validation auc = 0.707905
Epoch 677
Validation auc = 0.708944
Epoch 678
Validation auc = 0.706156
Epoch 679
Loss = 1.0399e-02, PNorm = 96.1808, GNorm = 0.1337, lr_0 = 9.6672e-04
Validation auc = 0.703914
Epoch 680
Validation auc = 0.704734
Epoch 681
Validation auc = 0.706648
Epoch 682
Validation auc = 0.709326
Epoch 683
Loss = 4.6399e-03, PNorm = 96.2583, GNorm = 0.1406, lr_0 = 9.6648e-04
Validation auc = 0.710748
Epoch 684
Validation auc = 0.711951
Epoch 685
Validation auc = 0.711787
Epoch 686
Validation auc = 0.708889
Epoch 687
Validation auc = 0.707468
Epoch 688
Loss = 3.6229e-03, PNorm = 96.2916, GNorm = 0.0476, lr_0 = 9.6624e-04
Loss = 3.2889e-03, PNorm = 96.2936, GNorm = 0.0948, lr_0 = 9.6622e-04
Validation auc = 0.706374
Epoch 689
Validation auc = 0.705336
Epoch 690
Validation auc = 0.704734
Epoch 691
Validation auc = 0.701236
Epoch 692
Validation auc = 0.698338
Epoch 693
Loss = 4.9215e-04, PNorm = 96.3228, GNorm = 0.0108, lr_0 = 9.6600e-04
Validation auc = 0.697299
Epoch 694
Validation auc = 0.697245
Epoch 695
Validation auc = 0.697190
Epoch 696
Validation auc = 0.697573
Epoch 697
Validation auc = 0.698174
Epoch 698
Loss = 1.0264e-03, PNorm = 96.3403, GNorm = 0.0193, lr_0 = 9.6574e-04
Validation auc = 0.700415
Epoch 699
Validation auc = 0.702001
Epoch 700
Validation auc = 0.703477
Epoch 701
Validation auc = 0.703969
Epoch 702
Loss = 2.7514e-02, PNorm = 96.3688, GNorm = 0.0732, lr_0 = 9.6552e-04
Loss = 1.2223e-04, PNorm = 96.3708, GNorm = 0.0060, lr_0 = 9.6550e-04
Validation auc = 0.707686
Epoch 703
Validation auc = 0.709709
Epoch 704
Validation auc = 0.715285
Epoch 705
Validation auc = 0.714520
Epoch 706
Validation auc = 0.703532
Epoch 707
Loss = 4.9663e-03, PNorm = 96.4327, GNorm = 0.0498, lr_0 = 9.6526e-04
Loss = 1.9338e-04, PNorm = 96.4404, GNorm = 0.0066, lr_0 = 9.6525e-04
Validation auc = 0.698994
Epoch 708
Validation auc = 0.693965
Epoch 709
Validation auc = 0.690138
Epoch 710
Validation auc = 0.687678
Epoch 711
Validation auc = 0.690083
Epoch 712
Loss = 1.4004e-03, PNorm = 96.5166, GNorm = 0.0442, lr_0 = 9.6502e-04
Validation auc = 0.691340
Epoch 713
Validation auc = 0.700251
Epoch 714
Validation auc = 0.705664
Epoch 715
Validation auc = 0.707468
Epoch 716
Loss = 1.7105e-03, PNorm = 96.5748, GNorm = 0.0382, lr_0 = 9.6479e-04
Validation auc = 0.709162
Epoch 717
Validation auc = 0.710639
Epoch 718
Validation auc = 0.715559
Epoch 719
Validation auc = 0.721244
Epoch 720
Validation auc = 0.724142
Epoch 721
Loss = 2.9772e-03, PNorm = 96.6146, GNorm = 0.1283, lr_0 = 9.6455e-04
Loss = 1.3226e-02, PNorm = 96.6167, GNorm = 1.1149, lr_0 = 9.6453e-04
Validation auc = 0.724306
Epoch 722
Validation auc = 0.722064
Epoch 723
Validation auc = 0.719714
Epoch 724
Validation auc = 0.720588
Epoch 725
Validation auc = 0.719823
Epoch 726
Loss = 1.8591e-03, PNorm = 96.6580, GNorm = 0.1323, lr_0 = 9.6431e-04
Validation auc = 0.719167
Epoch 727
Validation auc = 0.718019
Epoch 728
Validation auc = 0.718729
Epoch 729
Validation auc = 0.718675
Epoch 730
Validation auc = 0.715176
Epoch 731
Loss = 1.4253e-03, PNorm = 96.6757, GNorm = 0.0213, lr_0 = 9.6405e-04
Validation auc = 0.709326
Epoch 732
Validation auc = 0.707194
Epoch 733
Validation auc = 0.709053
Epoch 734
Validation auc = 0.698939
Epoch 735
Loss = 3.7349e-02, PNorm = 96.7757, GNorm = 1.4287, lr_0 = 9.6383e-04
Loss = 2.4191e-02, PNorm = 96.7845, GNorm = 1.4811, lr_0 = 9.6381e-04
Validation auc = 0.691778
Epoch 736
Validation auc = 0.687404
Epoch 737
Validation auc = 0.690794
Epoch 738
Validation auc = 0.692707
Epoch 739
Validation auc = 0.695167
Epoch 740
Loss = 5.5748e-03, PNorm = 96.9034, GNorm = 0.1789, lr_0 = 9.6357e-04
Loss = 2.3181e-04, PNorm = 96.9095, GNorm = 0.0074, lr_0 = 9.6355e-04
Validation auc = 0.697245
Epoch 741
Validation auc = 0.697354
Epoch 742
Validation auc = 0.701509
Epoch 743
Validation auc = 0.701673
Epoch 744
Validation auc = 0.704133
Epoch 745
Loss = 1.8885e-02, PNorm = 96.9882, GNorm = 0.7763, lr_0 = 9.6333e-04
Validation auc = 0.706101
Epoch 746
Validation auc = 0.706866
Epoch 747
Validation auc = 0.708014
Epoch 748
Validation auc = 0.708998
Epoch 749
Loss = 4.9071e-03, PNorm = 97.0543, GNorm = 0.0008, lr_0 = 9.6309e-04
Validation auc = 0.709764
Epoch 750
Validation auc = 0.709928
Epoch 751
Validation auc = 0.710529
Epoch 752
Validation auc = 0.711513
Epoch 753
Validation auc = 0.711021
Epoch 754
Loss = 2.8392e-02, PNorm = 97.0988, GNorm = 0.3485, lr_0 = 9.6285e-04
Loss = 8.6753e-04, PNorm = 97.1025, GNorm = 0.0279, lr_0 = 9.6284e-04
Validation auc = 0.708397
Epoch 755
Validation auc = 0.706757
Epoch 756
Validation auc = 0.705992
Epoch 757
Validation auc = 0.705390
Epoch 758
Validation auc = 0.705609
Epoch 759
Loss = 2.2958e-03, PNorm = 97.1573, GNorm = 0.1007, lr_0 = 9.6262e-04
Validation auc = 0.704844
Epoch 760
Validation auc = 0.706320
Epoch 761
Validation auc = 0.698447
Epoch 762
Validation auc = 0.699158
Epoch 763
Validation auc = 0.711131
Epoch 764
Loss = 1.0842e-01, PNorm = 97.2132, GNorm = 0.9780, lr_0 = 9.6236e-04
Validation auc = 0.717691
Epoch 765
Validation auc = 0.720643
Epoch 766
Validation auc = 0.718401
Epoch 767
Validation auc = 0.713591
Epoch 768
Loss = 8.8216e-02, PNorm = 97.4255, GNorm = 1.0194, lr_0 = 9.6214e-04
Loss = 2.4689e-02, PNorm = 97.4440, GNorm = 0.3689, lr_0 = 9.6212e-04
Validation auc = 0.708178
Epoch 769
Validation auc = 0.705226
Epoch 770
Validation auc = 0.702329
Epoch 771
Validation auc = 0.701017
Epoch 772
Validation auc = 0.703860
Epoch 773
Loss = 9.4011e-03, PNorm = 97.6804, GNorm = 0.1344, lr_0 = 9.6188e-04
Loss = 2.2463e-01, PNorm = 97.6913, GNorm = 6.8856, lr_0 = 9.6186e-04
Validation auc = 0.703914
Epoch 774
Validation auc = 0.701892
Epoch 775
Validation auc = 0.698010
Epoch 776
Validation auc = 0.699595
Epoch 777
Validation auc = 0.708725
Epoch 778
Loss = 3.8466e-02, PNorm = 97.8657, GNorm = 1.2298, lr_0 = 9.6164e-04
Validation auc = 0.707468
Epoch 779
Validation auc = 0.697791
Epoch 780
Validation auc = 0.691504
Epoch 781
Validation auc = 0.686803
Epoch 782
Validation auc = 0.685327
Epoch 783
Loss = 5.4371e-02, PNorm = 98.0264, GNorm = 0.9983, lr_0 = 9.6139e-04
Validation auc = 0.688279
Epoch 784
Validation auc = 0.693855
Epoch 785
Validation auc = 0.698994
Epoch 786
Validation auc = 0.702110
Epoch 787
Loss = 1.3080e-02, PNorm = 98.0890, GNorm = 0.7719, lr_0 = 9.6117e-04
Loss = 3.0423e-03, PNorm = 98.0935, GNorm = 0.0811, lr_0 = 9.6115e-04
Validation auc = 0.703258
Epoch 788
Validation auc = 0.702876
Epoch 789
Validation auc = 0.702602
Epoch 790
Validation auc = 0.701564
Epoch 791
Validation auc = 0.702056
Epoch 792
Loss = 1.9050e-03, PNorm = 98.1504, GNorm = 0.0457, lr_0 = 9.6093e-04
Validation auc = 0.700579
Epoch 793
Validation auc = 0.704625
Epoch 794
Validation auc = 0.707140
Epoch 795
Validation auc = 0.708452
Epoch 796
Validation auc = 0.710967
Epoch 797
Loss = 1.0863e-01, PNorm = 98.2089, GNorm = 0.7064, lr_0 = 9.6067e-04
Validation auc = 0.714356
Epoch 798
Validation auc = 0.715668
Epoch 799
Validation auc = 0.714848
Epoch 800
Validation auc = 0.715996
Epoch 801
Loss = 2.1031e-02, PNorm = 98.2451, GNorm = 0.6279, lr_0 = 9.6045e-04
Loss = 8.8538e-03, PNorm = 98.2492, GNorm = 0.2267, lr_0 = 9.6043e-04
Validation auc = 0.714575
Epoch 802
Validation auc = 0.713536
Epoch 803
Validation auc = 0.712115
Epoch 804
Validation auc = 0.711131
Epoch 805
Validation auc = 0.710584
Epoch 806
Loss = 1.6743e-03, PNorm = 98.3150, GNorm = 0.0588, lr_0 = 9.6019e-04
Loss = 6.8941e-04, PNorm = 98.3193, GNorm = 0.0185, lr_0 = 9.6018e-04
Validation auc = 0.709217
Epoch 807
Validation auc = 0.710420
Epoch 808
Validation auc = 0.710857
Epoch 809
Validation auc = 0.708616
Epoch 810
Validation auc = 0.705882
Epoch 811
Loss = 9.3817e-02, PNorm = 98.3505, GNorm = 0.6563, lr_0 = 9.5996e-04
Validation auc = 0.701673
Epoch 812
Validation auc = 0.703368
Epoch 813
Validation auc = 0.705117
Epoch 814
Validation auc = 0.705609
Epoch 815
Validation auc = 0.706046
Epoch 816
Loss = 1.9326e-03, PNorm = 98.3740, GNorm = 0.0355, lr_0 = 9.5970e-04
Validation auc = 0.706156
Epoch 817
Validation auc = 0.705664
Epoch 818
Validation auc = 0.706812
Epoch 819
Validation auc = 0.707796
Epoch 820
Loss = 6.0464e-02, PNorm = 98.4033, GNorm = 0.5168, lr_0 = 9.5948e-04
Loss = 4.3333e-04, PNorm = 98.4044, GNorm = 0.0121, lr_0 = 9.5946e-04
Validation auc = 0.708616
Epoch 821
Validation auc = 0.709272
Epoch 822
Validation auc = 0.714575
Epoch 823
Validation auc = 0.718456
Epoch 824
Validation auc = 0.721518
Epoch 825
Loss = 2.2313e-03, PNorm = 98.4150, GNorm = 0.0348, lr_0 = 9.5924e-04
Validation auc = 0.723650
Epoch 826
Validation auc = 0.724907
Epoch 827
Validation auc = 0.724524
Epoch 828
Validation auc = 0.723322
Epoch 829
Validation auc = 0.721627
Epoch 830
Loss = 3.5529e-03, PNorm = 98.4422, GNorm = 0.1346, lr_0 = 9.5899e-04
Validation auc = 0.720971
Epoch 831
Validation auc = 0.720862
Epoch 832
Validation auc = 0.720479
Epoch 833
Validation auc = 0.720042
Epoch 834
Loss = 1.0699e-03, PNorm = 98.4724, GNorm = 0.0219, lr_0 = 9.5877e-04
Loss = 5.4252e-04, PNorm = 98.4742, GNorm = 0.0448, lr_0 = 9.5875e-04
Validation auc = 0.719058
Epoch 835
Validation auc = 0.718729
Epoch 836
Validation auc = 0.718565
Epoch 837
Validation auc = 0.718839
Epoch 838
Validation auc = 0.718894
Epoch 839
Loss = 6.1464e-04, PNorm = 98.4953, GNorm = 0.0330, lr_0 = 9.5851e-04
Loss = 1.8825e-04, PNorm = 98.4965, GNorm = 0.0055, lr_0 = 9.5849e-04
Validation auc = 0.718839
Epoch 840
Validation auc = 0.719058
Epoch 841
Validation auc = 0.720042
Epoch 842
Validation auc = 0.722338
Epoch 843
Validation auc = 0.724032
Epoch 844
Loss = 3.9491e-04, PNorm = 98.5152, GNorm = 0.0075, lr_0 = 9.5827e-04
Validation auc = 0.724196
Epoch 845
Validation auc = 0.724196
Epoch 846
Validation auc = 0.722994
Epoch 847
Validation auc = 0.721682
Epoch 848
Validation auc = 0.719386
Epoch 849
Loss = 1.8827e-03, PNorm = 98.5404, GNorm = 0.0575, lr_0 = 9.5802e-04
Validation auc = 0.717253
Epoch 850
Validation auc = 0.715504
Epoch 851
Validation auc = 0.715176
Epoch 852
Validation auc = 0.713809
Epoch 853
Loss = 5.7500e-04, PNorm = 98.5707, GNorm = 0.0094, lr_0 = 9.5780e-04
Loss = 1.1222e-04, PNorm = 98.5726, GNorm = 0.0032, lr_0 = 9.5778e-04
Validation auc = 0.713317
Epoch 854
Validation auc = 0.712607
Epoch 855
Validation auc = 0.712279
Epoch 856
Validation auc = 0.711459
Epoch 857
Validation auc = 0.709818
Epoch 858
Loss = 3.5531e-04, PNorm = 98.5862, GNorm = 0.0080, lr_0 = 9.5754e-04
Validation auc = 0.706921
Epoch 859
Validation auc = 0.705390
Epoch 860
Validation auc = 0.703805
Epoch 861
Validation auc = 0.702766
Epoch 862
Validation auc = 0.701728
Epoch 863
Loss = 1.3382e-03, PNorm = 98.5892, GNorm = 0.0229, lr_0 = 9.5730e-04
Validation auc = 0.701892
Epoch 864
Validation auc = 0.702493
Epoch 865
Validation auc = 0.702165
Epoch 866
Validation auc = 0.702220
Epoch 867
Loss = 1.4362e-03, PNorm = 98.6073, GNorm = 0.0179, lr_0 = 9.5708e-04
Loss = 1.6784e-04, PNorm = 98.6086, GNorm = 0.0041, lr_0 = 9.5707e-04
Validation auc = 0.702220
Epoch 868
Validation auc = 0.701509
Epoch 869
Validation auc = 0.700306
Epoch 870
Validation auc = 0.699103
Epoch 871
Validation auc = 0.698174
Epoch 872
Loss = 1.5716e-03, PNorm = 98.6314, GNorm = 0.0477, lr_0 = 9.5683e-04
Loss = 4.0188e-04, PNorm = 98.6331, GNorm = 0.0119, lr_0 = 9.5681e-04
Validation auc = 0.697026
Epoch 873
Validation auc = 0.697026
Epoch 874
Validation auc = 0.697354
Epoch 875
Validation auc = 0.697245
Epoch 876
Validation auc = 0.697081
Epoch 877
Loss = 1.9102e-04, PNorm = 98.6517, GNorm = 0.0038, lr_0 = 9.5659e-04
Validation auc = 0.696753
Epoch 878
Validation auc = 0.697026
Epoch 879
Validation auc = 0.695441
Epoch 880
Validation auc = 0.694949
Epoch 881
Validation auc = 0.695003
Epoch 882
Loss = 2.8979e-03, PNorm = 98.6656, GNorm = 0.0943, lr_0 = 9.5634e-04
Validation auc = 0.694347
Epoch 883
Validation auc = 0.694785
Epoch 884
Validation auc = 0.694621
Epoch 885
Validation auc = 0.694457
Epoch 886
Loss = 4.5543e-02, PNorm = 98.6815, GNorm = 2.8805, lr_0 = 9.5612e-04
Loss = 1.3693e-03, PNorm = 98.6844, GNorm = 0.0386, lr_0 = 9.5610e-04
Validation auc = 0.697245
Epoch 887
Validation auc = 0.700962
Epoch 888
Validation auc = 0.701618
Epoch 889
Validation auc = 0.700251
Epoch 890
Validation auc = 0.698885
Epoch 891
Loss = 1.9261e-04, PNorm = 98.7296, GNorm = 0.0050, lr_0 = 9.5586e-04
Validation auc = 0.698283
Epoch 892
Validation auc = 0.698119
Epoch 893
Validation auc = 0.698174
Epoch 894
Validation auc = 0.698939
Epoch 895
Validation auc = 0.700251
Epoch 896
Loss = 1.3785e-04, PNorm = 98.7663, GNorm = 0.0030, lr_0 = 9.5563e-04
Validation auc = 0.700579
Epoch 897
Validation auc = 0.699759
Epoch 898
Validation auc = 0.698447
Epoch 899
Validation auc = 0.697846
Epoch 900
Loss = 3.0456e-04, PNorm = 98.7959, GNorm = 0.0049, lr_0 = 9.5541e-04
Loss = 1.4312e-04, PNorm = 98.7979, GNorm = 0.0084, lr_0 = 9.5539e-04
Validation auc = 0.698666
Epoch 901
Validation auc = 0.698830
Epoch 902
Validation auc = 0.698885
Epoch 903
Validation auc = 0.699322
Epoch 904
Validation auc = 0.698666
Epoch 905
Loss = 9.2938e-04, PNorm = 98.8198, GNorm = 0.0707, lr_0 = 9.5515e-04
Loss = 1.2578e-04, PNorm = 98.8214, GNorm = 0.0037, lr_0 = 9.5513e-04
Validation auc = 0.697901
Epoch 906
Validation auc = 0.697901
Epoch 907
Validation auc = 0.697573
Epoch 908
Validation auc = 0.697901
Epoch 909
Validation auc = 0.697463
Epoch 910
Loss = 3.5338e-03, PNorm = 98.8361, GNorm = 0.2488, lr_0 = 9.5491e-04
Validation auc = 0.697846
Epoch 911
Validation auc = 0.703532
Epoch 912
Validation auc = 0.710967
Epoch 913
Validation auc = 0.709818
Epoch 914
Validation auc = 0.708342
Epoch 915
Loss = 4.7947e-04, PNorm = 98.8576, GNorm = 0.0167, lr_0 = 9.5466e-04
Validation auc = 0.706921
Epoch 916
Validation auc = 0.706320
Epoch 917
Validation auc = 0.705992
Epoch 918
Validation auc = 0.705773
Epoch 919
Loss = 2.0509e-04, PNorm = 98.8735, GNorm = 0.0077, lr_0 = 9.5444e-04
Loss = 7.9137e-05, PNorm = 98.8745, GNorm = 0.0026, lr_0 = 9.5442e-04
Validation auc = 0.705828
Epoch 920
Validation auc = 0.706101
Epoch 921
Validation auc = 0.706429
Epoch 922
Validation auc = 0.706812
Epoch 923
Validation auc = 0.707249
Epoch 924
Loss = 2.1063e-03, PNorm = 98.8879, GNorm = 0.5191, lr_0 = 9.5419e-04
Validation auc = 0.707140
Epoch 925
Validation auc = 0.706046
Epoch 926
Validation auc = 0.703750
Epoch 927
Validation auc = 0.702548
Epoch 928
Validation auc = 0.700798
Epoch 929
Loss = 1.1473e-03, PNorm = 98.9103, GNorm = 0.0521, lr_0 = 9.5395e-04
Validation auc = 0.700251
Epoch 930
Validation auc = 0.699213
Epoch 931
Validation auc = 0.699650
Epoch 932
Validation auc = 0.700033
Epoch 933
Loss = 2.2021e-04, PNorm = 98.9287, GNorm = 0.0026, lr_0 = 9.5371e-04
Validation auc = 0.700033
Epoch 934
Validation auc = 0.700306
Epoch 935
Validation auc = 0.700525
Epoch 936
Validation auc = 0.700634
Epoch 937
Validation auc = 0.700634
Epoch 938
Loss = 8.9755e-05, PNorm = 98.9386, GNorm = 0.0024, lr_0 = 9.5348e-04
Loss = 2.7424e-04, PNorm = 98.9391, GNorm = 0.0089, lr_0 = 9.5346e-04
Validation auc = 0.700798
Epoch 939
Validation auc = 0.700525
Epoch 940
Validation auc = 0.700470
Epoch 941
Validation auc = 0.700525
Epoch 942
Validation auc = 0.700525
Epoch 943
Loss = 1.6961e-04, PNorm = 98.9447, GNorm = 0.0040, lr_0 = 9.5324e-04
Validation auc = 0.700579
Epoch 944
Validation auc = 0.700689
Epoch 945
Validation auc = 0.697791
Epoch 946
Validation auc = 0.697026
Epoch 947
Validation auc = 0.698447
Epoch 948
Loss = 2.8231e-02, PNorm = 98.9465, GNorm = 1.1902, lr_0 = 9.5299e-04
Validation auc = 0.701017
Epoch 949
Validation auc = 0.702876
Epoch 950
Validation auc = 0.703805
Epoch 951
Validation auc = 0.704570
Epoch 952
Loss = 2.3955e-04, PNorm = 98.9544, GNorm = 0.0020, lr_0 = 9.5277e-04
Loss = 5.2527e-05, PNorm = 98.9553, GNorm = 0.0017, lr_0 = 9.5275e-04
Validation auc = 0.704734
Epoch 953
Validation auc = 0.704734
Epoch 954
Validation auc = 0.704953
Epoch 955
Validation auc = 0.702220
Epoch 956
Validation auc = 0.699869
Epoch 957
Loss = 1.1960e-04, PNorm = 98.9719, GNorm = 0.0025, lr_0 = 9.5251e-04
Loss = 4.1564e-04, PNorm = 98.9731, GNorm = 0.0083, lr_0 = 9.5250e-04
Validation auc = 0.697245
Epoch 958
Validation auc = 0.695331
Epoch 959
Validation auc = 0.694074
Epoch 960
Validation auc = 0.693637
Epoch 961
Validation auc = 0.692325
Epoch 962
Loss = 7.4068e-04, PNorm = 98.9893, GNorm = 0.0232, lr_0 = 9.5228e-04
Validation auc = 0.694129
Epoch 963
Validation auc = 0.697081
Epoch 964
Validation auc = 0.700470
Epoch 965
Validation auc = 0.702384
Epoch 966
Loss = 7.1482e-04, PNorm = 98.9955, GNorm = 0.0208, lr_0 = 9.5204e-04
Validation auc = 0.703586
Epoch 967
Validation auc = 0.704516
Epoch 968
Validation auc = 0.705609
Epoch 969
Validation auc = 0.706484
Epoch 970
Validation auc = 0.707304
Epoch 971
Loss = 4.8381e-04, PNorm = 99.0088, GNorm = 0.0164, lr_0 = 9.5180e-04
Loss = 4.6408e-05, PNorm = 99.0097, GNorm = 0.0018, lr_0 = 9.5179e-04
Validation auc = 0.708124
Epoch 972
Validation auc = 0.707796
Epoch 973
Validation auc = 0.707741
Epoch 974
Validation auc = 0.707632
Epoch 975
Validation auc = 0.707741
Epoch 976
Loss = 1.1517e-04, PNorm = 99.0212, GNorm = 0.0025, lr_0 = 9.5157e-04
Validation auc = 0.707905
Epoch 977
Validation auc = 0.708069
Epoch 978
Validation auc = 0.708342
Epoch 979
Validation auc = 0.709436
Epoch 980
Validation auc = 0.709545
Epoch 981
Loss = 1.5824e-04, PNorm = 99.0394, GNorm = 0.0051, lr_0 = 9.5132e-04
Validation auc = 0.708069
Epoch 982
Validation auc = 0.707085
Epoch 983
Validation auc = 0.706374
Epoch 984
Validation auc = 0.705445
Epoch 985
Loss = 3.1990e-04, PNorm = 99.0616, GNorm = 0.0177, lr_0 = 9.5110e-04
Loss = 2.3212e-04, PNorm = 99.0628, GNorm = 0.0097, lr_0 = 9.5108e-04
Validation auc = 0.705445
Epoch 986
Validation auc = 0.704953
Epoch 987
Validation auc = 0.704844
Epoch 988
Validation auc = 0.704625
Epoch 989
Validation auc = 0.704844
Epoch 990
Loss = 1.5412e-04, PNorm = 99.0731, GNorm = 0.0046, lr_0 = 9.5084e-04
Loss = 4.0332e-06, PNorm = 99.0735, GNorm = 0.0002, lr_0 = 9.5083e-04
Validation auc = 0.704844
Epoch 991
Validation auc = 0.704844
Epoch 992
Validation auc = 0.705062
Epoch 993
Validation auc = 0.705117
Epoch 994
Validation auc = 0.705664
Epoch 995
Loss = 1.5320e-04, PNorm = 99.0820, GNorm = 0.0041, lr_0 = 9.5061e-04
Validation auc = 0.706101
Epoch 996
Validation auc = 0.706320
Epoch 997
Validation auc = 0.706648
Epoch 998
Validation auc = 0.707030
Epoch 999
Loss = 1.8965e-04, PNorm = 99.0907, GNorm = 0.0029, lr_0 = 9.5037e-04
Validation auc = 0.707194
Epoch 1000
Validation auc = 0.707249
Epoch 1001
Validation auc = 0.707358
Epoch 1002
Validation auc = 0.707358
Epoch 1003
Validation auc = 0.707249
Epoch 1004
Loss = 6.3266e-03, PNorm = 99.0950, GNorm = 1.3841, lr_0 = 9.5014e-04
Loss = 2.7815e-06, PNorm = 99.0948, GNorm = 0.0002, lr_0 = 9.5012e-04
Validation auc = 0.707194
Epoch 1005
Validation auc = 0.704898
Epoch 1006
Validation auc = 0.701782
Epoch 1007
Validation auc = 0.701564
Epoch 1008
Validation auc = 0.701673
Epoch 1009
Loss = 3.1604e-04, PNorm = 99.0983, GNorm = 0.0116, lr_0 = 9.4990e-04
Validation auc = 0.701728
Epoch 1010
Validation auc = 0.702056
Epoch 1011
Validation auc = 0.704898
Epoch 1012
Validation auc = 0.705992
Epoch 1013
Validation auc = 0.705445
Epoch 1014
Loss = 7.9298e-04, PNorm = 99.1061, GNorm = 0.0131, lr_0 = 9.4965e-04
Validation auc = 0.705718
Epoch 1015
Validation auc = 0.706320
Epoch 1016
Validation auc = 0.706702
Epoch 1017
Validation auc = 0.707905
Epoch 1018
Loss = 2.5205e-03, PNorm = 99.1384, GNorm = 0.0384, lr_0 = 9.4943e-04
Loss = 2.2171e-03, PNorm = 99.1414, GNorm = 0.0671, lr_0 = 9.4941e-04
Validation auc = 0.708397
Epoch 1019
Validation auc = 0.708616
Epoch 1020
Validation auc = 0.709764
Epoch 1021
Validation auc = 0.712060
Epoch 1022
Validation auc = 0.712771
Epoch 1023
Loss = 2.2072e-04, PNorm = 99.1867, GNorm = 0.0058, lr_0 = 9.4918e-04
Loss = 3.8502e-05, PNorm = 99.1892, GNorm = 0.0009, lr_0 = 9.4916e-04
Validation auc = 0.714137
Epoch 1024
Validation auc = 0.713973
Epoch 1025
Validation auc = 0.713317
Epoch 1026
Validation auc = 0.715067
Epoch 1027
Validation auc = 0.715723
Epoch 1028
Loss = 3.9823e-04, PNorm = 99.2206, GNorm = 0.0078, lr_0 = 9.4894e-04
Validation auc = 0.717253
Epoch 1029
Validation auc = 0.717089
Epoch 1030
Validation auc = 0.718073
Epoch 1031
Validation auc = 0.718948
Epoch 1032
Validation auc = 0.719550
Epoch 1033
Loss = 3.1976e-04, PNorm = 99.2507, GNorm = 0.0072, lr_0 = 9.4869e-04
Validation auc = 0.719987
Epoch 1034
Validation auc = 0.719823
Epoch 1035
Validation auc = 0.719714
Epoch 1036
Validation auc = 0.719495
Epoch 1037
Loss = 1.0468e-02, PNorm = 99.2701, GNorm = 1.0423, lr_0 = 9.4847e-04
Loss = 1.3931e-04, PNorm = 99.2708, GNorm = 0.0041, lr_0 = 9.4845e-04
Validation auc = 0.719112
Epoch 1038
Validation auc = 0.718401
Epoch 1039
Validation auc = 0.717909
Epoch 1040
Validation auc = 0.719112
Epoch 1041
Validation auc = 0.719276
Epoch 1042
Loss = 8.8634e-05, PNorm = 99.2828, GNorm = 0.0021, lr_0 = 9.4823e-04
Validation auc = 0.719222
Epoch 1043
Validation auc = 0.718292
Epoch 1044
Validation auc = 0.718073
Epoch 1045
Validation auc = 0.717745
Epoch 1046
Validation auc = 0.717253
Epoch 1047
Loss = 2.5970e-02, PNorm = 99.3089, GNorm = 1.1608, lr_0 = 9.4798e-04
Validation auc = 0.715504
Epoch 1048
Validation auc = 0.713481
Epoch 1049
Validation auc = 0.713153
Epoch 1050
Validation auc = 0.711951
Epoch 1051
Loss = 9.4570e-04, PNorm = 99.3387, GNorm = 0.0775, lr_0 = 9.4776e-04
Loss = 3.7112e-04, PNorm = 99.3404, GNorm = 0.0221, lr_0 = 9.4775e-04
Validation auc = 0.711131
Epoch 1052
Validation auc = 0.710529
Epoch 1053
Validation auc = 0.709764
Epoch 1054
Validation auc = 0.709326
Epoch 1055
Validation auc = 0.709272
Epoch 1056
Loss = 1.0357e-04, PNorm = 99.3573, GNorm = 0.0080, lr_0 = 9.4751e-04
Loss = 1.1325e-06, PNorm = 99.3583, GNorm = 0.0001, lr_0 = 9.4749e-04
Validation auc = 0.709764
Epoch 1057
Validation auc = 0.709600
Epoch 1058
Validation auc = 0.708889
Epoch 1059
Validation auc = 0.708670
Epoch 1060
Validation auc = 0.708506
Epoch 1061
Loss = 1.3105e-05, PNorm = 99.3669, GNorm = 0.0003, lr_0 = 9.4728e-04
Validation auc = 0.708288
Epoch 1062
Validation auc = 0.707686
Epoch 1063
Validation auc = 0.707030
Epoch 1064
Validation auc = 0.706866
Epoch 1065
Validation auc = 0.706265
Epoch 1066
Loss = 2.9637e-05, PNorm = 99.3858, GNorm = 0.0008, lr_0 = 9.4702e-04
Validation auc = 0.705664
Epoch 1067
Validation auc = 0.705281
Epoch 1068
Validation auc = 0.705390
Epoch 1069
Validation auc = 0.705336
Epoch 1070
Loss = 8.4279e-05, PNorm = 99.3955, GNorm = 0.0014, lr_0 = 9.4681e-04
Loss = 3.9935e-06, PNorm = 99.3959, GNorm = 0.0002, lr_0 = 9.4679e-04
Validation auc = 0.705281
Epoch 1071
Validation auc = 0.705445
Epoch 1072
Validation auc = 0.705500
Epoch 1073
Validation auc = 0.705500
Epoch 1074
Validation auc = 0.706538
Epoch 1075
Loss = 4.6764e-05, PNorm = 99.4012, GNorm = 0.0016, lr_0 = 9.4657e-04
Validation auc = 0.707741
Epoch 1076
Validation auc = 0.707960
Epoch 1077
Validation auc = 0.708725
Epoch 1078
Validation auc = 0.708452
Epoch 1079
Validation auc = 0.707960
Epoch 1080
Loss = 1.4559e-05, PNorm = 99.4146, GNorm = 0.0005, lr_0 = 9.4632e-04
Validation auc = 0.707741
Epoch 1081
Validation auc = 0.707850
Epoch 1082
Validation auc = 0.710475
Epoch 1083
Validation auc = 0.711349
Epoch 1084
Loss = 1.2324e-05, PNorm = 99.4156, GNorm = 0.0003, lr_0 = 9.4610e-04
Loss = 2.0464e-06, PNorm = 99.4157, GNorm = 0.0001, lr_0 = 9.4608e-04
Validation auc = 0.712060
Epoch 1085
Validation auc = 0.712279
Epoch 1086
Validation auc = 0.712115
Epoch 1087
Validation auc = 0.712279
Epoch 1088
Validation auc = 0.712388
Epoch 1089
Loss = 1.1599e-05, PNorm = 99.4182, GNorm = 0.0005, lr_0 = 9.4585e-04
Loss = 8.2252e-06, PNorm = 99.4184, GNorm = 0.0003, lr_0 = 9.4583e-04
Validation auc = 0.712224
Epoch 1090
Validation auc = 0.712333
Epoch 1091
Validation auc = 0.712443
Epoch 1092
Validation auc = 0.710475
Epoch 1093
Validation auc = 0.709326
Epoch 1094
Loss = 8.1605e-06, PNorm = 99.4234, GNorm = 0.0002, lr_0 = 9.4561e-04
Validation auc = 0.708069
Epoch 1095
Validation auc = 0.707413
Epoch 1096
Validation auc = 0.706374
Epoch 1097
Validation auc = 0.705445
Epoch 1098
Validation auc = 0.704734
Epoch 1099
Loss = 7.3956e-06, PNorm = 99.4277, GNorm = 0.0002, lr_0 = 9.4536e-04
Validation auc = 0.704242
Epoch 1100
Validation auc = 0.703805
Epoch 1101
Validation auc = 0.703696
Epoch 1102
Validation auc = 0.703477
Epoch 1103
Loss = 5.1268e-05, PNorm = 99.4388, GNorm = 0.0013, lr_0 = 9.4515e-04
Loss = 4.1127e-06, PNorm = 99.4395, GNorm = 0.0002, lr_0 = 9.4513e-04
Validation auc = 0.703204
Epoch 1104
Validation auc = 0.702438
Epoch 1105
Validation auc = 0.701345
Epoch 1106
Validation auc = 0.700251
Epoch 1107
Validation auc = 0.699377
Epoch 1108
Loss = 8.4344e-05, PNorm = 99.4476, GNorm = 0.0035, lr_0 = 9.4489e-04
Validation auc = 0.698666
Epoch 1109
Validation auc = 0.698229
Epoch 1110
Validation auc = 0.697901
Epoch 1111
Validation auc = 0.697627
Epoch 1112
Validation auc = 0.697627
Epoch 1113
Loss = 1.9602e-04, PNorm = 99.4514, GNorm = 0.0135, lr_0 = 9.4466e-04
Validation auc = 0.698229
Epoch 1114
Validation auc = 0.698229
Epoch 1115
Validation auc = 0.698174
Epoch 1116
Validation auc = 0.698174
Epoch 1117
Loss = 5.3682e-05, PNorm = 99.4546, GNorm = 0.0031, lr_0 = 9.4444e-04
Loss = 1.5179e-05, PNorm = 99.4548, GNorm = 0.0006, lr_0 = 9.4443e-04
Validation auc = 0.698283
Epoch 1118
Validation auc = 0.698229
Epoch 1119
Validation auc = 0.698338
Epoch 1120
Validation auc = 0.698393
Epoch 1121
Validation auc = 0.698338
Epoch 1122
Loss = 5.8605e-04, PNorm = 99.4568, GNorm = 0.1092, lr_0 = 9.4419e-04
Loss = 2.5191e-05, PNorm = 99.4571, GNorm = 0.0012, lr_0 = 9.4417e-04
Validation auc = 0.698557
Epoch 1123
Validation auc = 0.698611
Epoch 1124
Validation auc = 0.698502
Epoch 1125
Validation auc = 0.698283
Epoch 1126
Validation auc = 0.698229
Epoch 1127
Loss = 2.0044e-05, PNorm = 99.4606, GNorm = 0.0006, lr_0 = 9.4396e-04
Validation auc = 0.698065
Epoch 1128
Validation auc = 0.698174
Epoch 1129
Validation auc = 0.698338
Epoch 1130
Validation auc = 0.698393
Epoch 1131
Validation auc = 0.698393
Epoch 1132
Loss = 4.6747e-05, PNorm = 99.4637, GNorm = 0.0014, lr_0 = 9.4371e-04
Validation auc = 0.698557
Epoch 1133
Validation auc = 0.698611
Epoch 1134
Validation auc = 0.698502
Epoch 1135
Validation auc = 0.698721
Epoch 1136
Loss = 1.4100e-05, PNorm = 99.4654, GNorm = 0.0005, lr_0 = 9.4349e-04
Loss = 1.0739e-04, PNorm = 99.4655, GNorm = 0.0078, lr_0 = 9.4347e-04
Validation auc = 0.698721
Epoch 1137
Validation auc = 0.698775
Epoch 1138
Validation auc = 0.698721
Epoch 1139
Validation auc = 0.698721
Epoch 1140
Validation auc = 0.698666
Epoch 1141
Loss = 4.1235e-05, PNorm = 99.4673, GNorm = 0.0023, lr_0 = 9.4324e-04
Validation auc = 0.698721
Epoch 1142
Validation auc = 0.698721
Epoch 1143
Validation auc = 0.698775
Epoch 1144
Validation auc = 0.698721
Epoch 1145
Validation auc = 0.698666
Epoch 1146
Loss = 1.0791e-04, PNorm = 99.4690, GNorm = 0.0052, lr_0 = 9.4300e-04
Validation auc = 0.698666
Epoch 1147
Validation auc = 0.698775
Epoch 1148
Validation auc = 0.698775
Epoch 1149
Validation auc = 0.698775
Epoch 1150
Loss = 3.3367e-04, PNorm = 99.4701, GNorm = 0.1140, lr_0 = 9.4279e-04
Loss = 3.5763e-07, PNorm = 99.4701, GNorm = 0.0000, lr_0 = 9.4277e-04
Validation auc = 0.698721
Epoch 1151
Validation auc = 0.698830
Epoch 1152
Validation auc = 0.698885
Epoch 1153
Validation auc = 0.698666
Epoch 1154
Validation auc = 0.697791
Epoch 1155
Loss = 2.8945e-05, PNorm = 99.4784, GNorm = 0.0011, lr_0 = 9.4253e-04
Loss = 3.4173e-06, PNorm = 99.4788, GNorm = 0.0002, lr_0 = 9.4252e-04
Validation auc = 0.697573
Epoch 1156
Validation auc = 0.697081
Epoch 1157
Validation auc = 0.696753
Epoch 1158
Validation auc = 0.696807
Epoch 1159
Validation auc = 0.696589
Epoch 1160
Loss = 1.3612e-05, PNorm = 99.4821, GNorm = 0.0006, lr_0 = 9.4230e-04
Validation auc = 0.696589
Epoch 1161
Validation auc = 0.696425
Epoch 1162
Validation auc = 0.696206
Epoch 1163
Validation auc = 0.696151
Epoch 1164
Validation auc = 0.696097
Epoch 1165
Loss = 3.1620e-05, PNorm = 99.4842, GNorm = 0.0010, lr_0 = 9.4205e-04
Validation auc = 0.695769
Epoch 1166
Validation auc = 0.695714
Epoch 1167
Validation auc = 0.695659
Epoch 1168
Validation auc = 0.695659
Epoch 1169
Loss = 3.6219e-05, PNorm = 99.4853, GNorm = 0.0013, lr_0 = 9.4183e-04
Loss = 3.9537e-06, PNorm = 99.4854, GNorm = 0.0002, lr_0 = 9.4182e-04
Validation auc = 0.695769
Epoch 1170
Validation auc = 0.695769
Epoch 1171
Validation auc = 0.695659
Epoch 1172
Validation auc = 0.695878
Epoch 1173
Validation auc = 0.696042
Epoch 1174
Loss = 6.4574e-06, PNorm = 99.4861, GNorm = 0.0003, lr_0 = 9.4158e-04
Validation auc = 0.696042
Epoch 1175
Validation auc = 0.696042
Epoch 1176
Validation auc = 0.696261
Epoch 1177
Validation auc = 0.696425
Epoch 1178
Validation auc = 0.696479
Epoch 1179
Loss = 3.2336e-05, PNorm = 99.4867, GNorm = 0.0018, lr_0 = 9.4135e-04
Validation auc = 0.696479
Epoch 1180
Validation auc = 0.696479
Epoch 1181
Validation auc = 0.696534
Epoch 1182
Validation auc = 0.696534
Epoch 1183
Loss = 1.7810e-05, PNorm = 99.4873, GNorm = 0.0008, lr_0 = 9.4112e-04
Validation auc = 0.696534
Epoch 1184
Validation auc = 0.696479
Epoch 1185
Validation auc = 0.696643
Epoch 1186
Validation auc = 0.696643
Epoch 1187
Validation auc = 0.696753
Epoch 1188
Loss = 3.5964e-06, PNorm = 99.4884, GNorm = 0.0002, lr_0 = 9.4088e-04
Loss = 6.5316e-05, PNorm = 99.4884, GNorm = 0.0020, lr_0 = 9.4087e-04
Validation auc = 0.696862
Epoch 1189
Validation auc = 0.696862
Epoch 1190
Validation auc = 0.696917
Epoch 1191
Validation auc = 0.696971
Epoch 1192
Validation auc = 0.696971
Epoch 1193
Loss = 4.0362e-06, PNorm = 99.4891, GNorm = 0.0001, lr_0 = 9.4065e-04
Validation auc = 0.696917
Epoch 1194
Validation auc = 0.696917
Epoch 1195
Validation auc = 0.696917
Epoch 1196
Validation auc = 0.696917
Epoch 1197
Validation auc = 0.696807
Epoch 1198
Loss = 2.2959e-06, PNorm = 99.4908, GNorm = 0.0001, lr_0 = 9.4040e-04
Validation auc = 0.696534
Epoch 1199
Validation auc = 0.696589
Epoch 1200
Validation auc = 0.696643
Epoch 1201
Validation auc = 0.696698
Epoch 1202
Loss = 1.5547e-05, PNorm = 99.4921, GNorm = 0.0013, lr_0 = 9.4018e-04
Loss = 2.3026e-05, PNorm = 99.4922, GNorm = 0.0011, lr_0 = 9.4016e-04
Validation auc = 0.696643
Epoch 1203
Validation auc = 0.696753
Epoch 1204
Validation auc = 0.696698
Epoch 1205
Validation auc = 0.696753
Epoch 1206
Validation auc = 0.696753
Epoch 1207
Loss = 3.9815e-06, PNorm = 99.4930, GNorm = 0.0001, lr_0 = 9.3993e-04
Loss = 1.7484e-06, PNorm = 99.4930, GNorm = 0.0001, lr_0 = 9.3991e-04
Validation auc = 0.696807
Epoch 1208
Validation auc = 0.696753
Epoch 1209
Validation auc = 0.696643
Epoch 1210
Validation auc = 0.696534
Epoch 1211
Validation auc = 0.696534
Epoch 1212
Loss = 1.6522e-06, PNorm = 99.4934, GNorm = 0.0001, lr_0 = 9.3970e-04
Validation auc = 0.696479
Epoch 1213
Validation auc = 0.696425
Epoch 1214
Validation auc = 0.696479
Epoch 1215
Validation auc = 0.696425
Epoch 1216
Loss = 8.8612e-06, PNorm = 99.4941, GNorm = 0.0000, lr_0 = 9.3946e-04
Validation auc = 0.696479
Epoch 1217
Validation auc = 0.696534
Epoch 1218
Validation auc = 0.696479
Epoch 1219
Validation auc = 0.696479
Epoch 1220
Validation auc = 0.696479
Epoch 1221
Loss = 1.1459e-05, PNorm = 99.4946, GNorm = 0.0001, lr_0 = 9.3923e-04
Loss = 2.7418e-06, PNorm = 99.4947, GNorm = 0.0001, lr_0 = 9.3922e-04
Validation auc = 0.696479
Epoch 1222
Validation auc = 0.696479
Epoch 1223
Validation auc = 0.696534
Epoch 1224
Validation auc = 0.696425
Epoch 1225
Validation auc = 0.696425
Epoch 1226
Loss = 3.5404e-06, PNorm = 99.4952, GNorm = 0.0001, lr_0 = 9.3900e-04
Validation auc = 0.696370
Epoch 1227
Validation auc = 0.696370
Epoch 1228
Validation auc = 0.696370
Epoch 1229
Validation auc = 0.696370
Epoch 1230
Validation auc = 0.696315
Epoch 1231
Loss = 7.5219e-05, PNorm = 99.4958, GNorm = 0.0128, lr_0 = 9.3875e-04
Validation auc = 0.696425
Epoch 1232
Validation auc = 0.696370
Epoch 1233
Validation auc = 0.696370
Epoch 1234
Validation auc = 0.696315
Epoch 1235
Loss = 2.3806e-06, PNorm = 99.4967, GNorm = 0.0001, lr_0 = 9.3853e-04
Loss = 1.4444e-05, PNorm = 99.4968, GNorm = 0.0005, lr_0 = 9.3852e-04
Validation auc = 0.696261
Epoch 1236
Validation auc = 0.696315
Epoch 1237
Validation auc = 0.696315
Epoch 1238
Validation auc = 0.696315
Epoch 1239
Validation auc = 0.696370
Epoch 1240
Loss = 1.8608e-05, PNorm = 99.4974, GNorm = 0.0001, lr_0 = 9.3828e-04
Loss = 1.1921e-07, PNorm = 99.4975, GNorm = 0.0000, lr_0 = 9.3827e-04
Validation auc = 0.696370
Epoch 1241
Validation auc = 0.696315
Epoch 1242
Validation auc = 0.696261
Epoch 1243
Validation auc = 0.696097
Epoch 1244
Validation auc = 0.695878
Epoch 1245
Loss = 2.4962e-06, PNorm = 99.5004, GNorm = 0.0001, lr_0 = 9.3805e-04
Validation auc = 0.695605
Epoch 1246
Validation auc = 0.695386
Epoch 1247
Validation auc = 0.695058
Epoch 1248
Validation auc = 0.695113
Epoch 1249
Loss = 5.6644e-06, PNorm = 99.5031, GNorm = 0.0003, lr_0 = 9.3782e-04
Validation auc = 0.695003
Epoch 1250
Validation auc = 0.694949
Epoch 1251
Validation auc = 0.694949
Epoch 1252
Validation auc = 0.694949
Epoch 1253
Validation auc = 0.694839
Epoch 1254
Loss = 3.7824e-06, PNorm = 99.5039, GNorm = 0.0001, lr_0 = 9.3758e-04
Loss = 2.5034e-06, PNorm = 99.5040, GNorm = 0.0001, lr_0 = 9.3757e-04
Validation auc = 0.694675
Epoch 1255
Validation auc = 0.694730
Epoch 1256
Validation auc = 0.694675
Epoch 1257
Validation auc = 0.694675
Epoch 1258
Validation auc = 0.694675
Epoch 1259
Loss = 5.4451e-06, PNorm = 99.5044, GNorm = 0.0002, lr_0 = 9.3735e-04
Validation auc = 0.694675
Epoch 1260
Validation auc = 0.694675
Epoch 1261
Validation auc = 0.694675
Epoch 1262
Validation auc = 0.694675
Epoch 1263
Validation auc = 0.694675
Epoch 1264
Loss = 2.6273e-06, PNorm = 99.5049, GNorm = 0.0001, lr_0 = 9.3710e-04
Validation auc = 0.694621
Epoch 1265
Validation auc = 0.694511
Epoch 1266
Validation auc = 0.694566
Epoch 1267
Validation auc = 0.694566
Epoch 1268
Loss = 8.4709e-06, PNorm = 99.5053, GNorm = 0.0001, lr_0 = 9.3689e-04
Loss = 3.3577e-06, PNorm = 99.5053, GNorm = 0.0002, lr_0 = 9.3687e-04
Validation auc = 0.694511
Epoch 1269
Validation auc = 0.694457
Epoch 1270
Validation auc = 0.694457
Epoch 1271
Validation auc = 0.694457
Epoch 1272
Validation auc = 0.694347
Epoch 1273
Loss = 1.0805e-05, PNorm = 99.5060, GNorm = 0.0001, lr_0 = 9.3664e-04
Loss = 2.1855e-07, PNorm = 99.5060, GNorm = 0.0000, lr_0 = 9.3662e-04
Validation auc = 0.694511
Epoch 1274
Validation auc = 0.694621
Epoch 1275
Validation auc = 0.694566
Epoch 1276
Validation auc = 0.694566
Epoch 1277
Validation auc = 0.694566
Epoch 1278
Loss = 4.0721e-06, PNorm = 99.5065, GNorm = 0.0002, lr_0 = 9.3641e-04
Validation auc = 0.694566
Epoch 1279
Validation auc = 0.694621
Epoch 1280
Validation auc = 0.694621
Epoch 1281
Validation auc = 0.694621
Epoch 1282
Validation auc = 0.694621
Epoch 1283
Loss = 1.2814e-05, PNorm = 99.5070, GNorm = 0.0004, lr_0 = 9.3616e-04
Validation auc = 0.694566
Epoch 1284
Validation auc = 0.694566
Epoch 1285
Validation auc = 0.694566
Epoch 1286
Validation auc = 0.694566
Epoch 1287
Loss = 5.0208e-06, PNorm = 99.5074, GNorm = 0.0001, lr_0 = 9.3594e-04
Loss = 5.2650e-06, PNorm = 99.5074, GNorm = 0.0008, lr_0 = 9.3592e-04
Validation auc = 0.694566
Epoch 1288
Validation auc = 0.694511
Epoch 1289
Validation auc = 0.694511
Epoch 1290
Validation auc = 0.694511
Epoch 1291
Validation auc = 0.694566
Epoch 1292
Loss = 4.2127e-06, PNorm = 99.5078, GNorm = 0.0004, lr_0 = 9.3571e-04
Validation auc = 0.694566
Epoch 1293
Validation auc = 0.694511
Epoch 1294
Validation auc = 0.694511
Epoch 1295
Validation auc = 0.694511
Epoch 1296
Validation auc = 0.694511
Epoch 1297
Loss = 7.8455e-06, PNorm = 99.5082, GNorm = 0.0005, lr_0 = 9.3546e-04
Validation auc = 0.694511
Epoch 1298
Validation auc = 0.694566
Epoch 1299
Validation auc = 0.694457
Epoch 1300
Validation auc = 0.694457
Epoch 1301
Loss = 3.2328e-06, PNorm = 99.5087, GNorm = 0.0001, lr_0 = 9.3524e-04
Loss = 1.5895e-07, PNorm = 99.5087, GNorm = 0.0000, lr_0 = 9.3523e-04
Validation auc = 0.694457
Epoch 1302
Validation auc = 0.694457
Epoch 1303
Validation auc = 0.694402
Epoch 1304
Validation auc = 0.694402
Epoch 1305
Validation auc = 0.694402
Epoch 1306
Loss = 2.4127e-06, PNorm = 99.5091, GNorm = 0.0001, lr_0 = 9.3499e-04
Loss = 2.1855e-07, PNorm = 99.5091, GNorm = 0.0000, lr_0 = 9.3498e-04
Validation auc = 0.694402
Epoch 1307
Validation auc = 0.694402
Epoch 1308
Validation auc = 0.694402
Epoch 1309
Validation auc = 0.694402
Epoch 1310
Validation auc = 0.694457
Epoch 1311
Loss = 6.8489e-06, PNorm = 99.5094, GNorm = 0.0010, lr_0 = 9.3476e-04
Validation auc = 0.694457
Epoch 1312
Validation auc = 0.694457
Epoch 1313
Validation auc = 0.694457
Epoch 1314
Validation auc = 0.694457
Epoch 1315
Validation auc = 0.694457
Epoch 1316
Loss = 1.8358e-06, PNorm = 99.5099, GNorm = 0.0001, lr_0 = 9.3451e-04
Validation auc = 0.694457
Epoch 1317
Validation auc = 0.694457
Epoch 1318
Validation auc = 0.694402
Epoch 1319
Validation auc = 0.694402
Epoch 1320
Loss = 3.8586e-06, PNorm = 99.5103, GNorm = 0.0002, lr_0 = 9.3430e-04
Loss = 1.4901e-06, PNorm = 99.5103, GNorm = 0.0001, lr_0 = 9.3428e-04
Validation auc = 0.694402
Epoch 1321
Validation auc = 0.694347
Epoch 1322
Validation auc = 0.694402
Epoch 1323
Validation auc = 0.694347
Epoch 1324
Validation auc = 0.694347
Epoch 1325
Loss = 7.3708e-06, PNorm = 99.5106, GNorm = 0.0003, lr_0 = 9.3407e-04
Validation auc = 0.694347
Epoch 1326
Validation auc = 0.694347
Epoch 1327
Validation auc = 0.694347
Epoch 1328
Validation auc = 0.694347
Epoch 1329
Validation auc = 0.694347
Epoch 1330
Loss = 2.2673e-06, PNorm = 99.5110, GNorm = 0.0001, lr_0 = 9.3382e-04
Validation auc = 0.694347
Epoch 1331
Validation auc = 0.694293
Epoch 1332
Validation auc = 0.694293
Epoch 1333
Validation auc = 0.694293
Epoch 1334
Loss = 4.5568e-06, PNorm = 99.5118, GNorm = 0.0003, lr_0 = 9.3360e-04
Loss = 3.1789e-06, PNorm = 99.5118, GNorm = 0.0002, lr_0 = 9.3359e-04
Validation auc = 0.694293
Epoch 1335
Validation auc = 0.694293
Epoch 1336
Validation auc = 0.694293
Epoch 1337
Validation auc = 0.694293
Epoch 1338
Validation auc = 0.694347
Epoch 1339
Loss = 6.5710e-06, PNorm = 99.5128, GNorm = 0.0001, lr_0 = 9.3336e-04
Loss = 9.9341e-08, PNorm = 99.5129, GNorm = 0.0000, lr_0 = 9.3334e-04
Validation auc = 0.694293
Epoch 1340
Validation auc = 0.694129
Epoch 1341
Validation auc = 0.693965
Epoch 1342
Validation auc = 0.694019
Epoch 1343
Validation auc = 0.693965
Epoch 1344
Loss = 5.3424e-06, PNorm = 99.5146, GNorm = 0.0004, lr_0 = 9.3312e-04
Validation auc = 0.693965
Epoch 1345
Validation auc = 0.693910
Epoch 1346
Validation auc = 0.693801
Epoch 1347
Validation auc = 0.693801
Epoch 1348
Validation auc = 0.693691
Epoch 1349
Loss = 3.6190e-06, PNorm = 99.5160, GNorm = 0.0002, lr_0 = 9.3288e-04
Validation auc = 0.693691
Epoch 1350
Validation auc = 0.693691
Epoch 1351
Validation auc = 0.693691
Epoch 1352
Validation auc = 0.693691
Epoch 1353
Loss = 2.4700e-06, PNorm = 99.5168, GNorm = 0.0000, lr_0 = 9.3266e-04
Loss = 0.0000e+00, PNorm = 99.5169, GNorm = 0.0000, lr_0 = 9.3264e-04
Validation auc = 0.693691
Epoch 1354
Validation auc = 0.693691
Epoch 1355
Validation auc = 0.693691
Epoch 1356
Validation auc = 0.693691
Epoch 1357
Validation auc = 0.693637
Epoch 1358
Loss = 3.0660e-06, PNorm = 99.5176, GNorm = 0.0001, lr_0 = 9.3241e-04
Validation auc = 0.693637
Epoch 1359
Validation auc = 0.693527
Epoch 1360
Validation auc = 0.693582
Epoch 1361
Validation auc = 0.693582
Epoch 1362
Validation auc = 0.693582
Epoch 1363
Loss = 1.8806e-05, PNorm = 99.5181, GNorm = 0.0029, lr_0 = 9.3218e-04
Validation auc = 0.693637
Epoch 1364
Validation auc = 0.693637
Epoch 1365
Validation auc = 0.693637
Epoch 1366
Validation auc = 0.693637
Epoch 1367
Loss = 4.4939e-06, PNorm = 99.5187, GNorm = 0.0004, lr_0 = 9.3197e-04
Loss = 0.0000e+00, PNorm = 99.5187, GNorm = 0.0000, lr_0 = 9.3195e-04
Validation auc = 0.693637
Epoch 1368
Validation auc = 0.693637
Epoch 1369
Validation auc = 0.693691
Epoch 1370
Validation auc = 0.693746
Epoch 1371
Validation auc = 0.693855
Epoch 1372
Loss = 2.7726e-06, PNorm = 99.5192, GNorm = 0.0001, lr_0 = 9.3172e-04
Loss = 0.0000e+00, PNorm = 99.5192, GNorm = 0.0000, lr_0 = 9.3170e-04
Validation auc = 0.693855
Epoch 1373
Validation auc = 0.693910
Epoch 1374
Validation auc = 0.693910
Epoch 1375
Validation auc = 0.694074
Epoch 1376
Validation auc = 0.694129
Epoch 1377
Loss = 1.0894e-04, PNorm = 99.5203, GNorm = 0.0136, lr_0 = 9.3149e-04
Validation auc = 0.694074
Epoch 1378
Validation auc = 0.694183
Epoch 1379
Validation auc = 0.694183
Epoch 1380
Validation auc = 0.694293
Epoch 1381
Validation auc = 0.694347
Epoch 1382
Loss = 5.7384e-06, PNorm = 99.5218, GNorm = 0.0002, lr_0 = 9.3124e-04
Validation auc = 0.694238
Epoch 1383
Validation auc = 0.694347
Epoch 1384
Validation auc = 0.694347
Epoch 1385
Validation auc = 0.694347
Epoch 1386
Loss = 4.6997e-06, PNorm = 99.5223, GNorm = 0.0005, lr_0 = 9.3102e-04
Loss = 2.7815e-07, PNorm = 99.5223, GNorm = 0.0000, lr_0 = 9.3101e-04
Validation auc = 0.694347
Epoch 1387
Validation auc = 0.694347
Epoch 1388
Validation auc = 0.694293
Epoch 1389
Validation auc = 0.694293
Epoch 1390
Validation auc = 0.694293
Epoch 1391
Loss = 1.8978e-06, PNorm = 99.5228, GNorm = 0.0000, lr_0 = 9.3078e-04
Validation auc = 0.694265
Epoch 1392
Validation auc = 0.694265
Epoch 1393
Validation auc = 0.694293
Epoch 1394
Validation auc = 0.694320
Epoch 1395
Validation auc = 0.694265
Epoch 1396
Loss = 6.5823e-06, PNorm = 99.5233, GNorm = 0.0002, lr_0 = 9.3055e-04
Validation auc = 0.694211
Epoch 1397
Validation auc = 0.694265
Epoch 1398
Validation auc = 0.694265
Epoch 1399
Validation auc = 0.694265
Epoch 1400
Loss = 1.5712e-06, PNorm = 99.5236, GNorm = 0.0002, lr_0 = 9.3033e-04
Loss = 1.1126e-06, PNorm = 99.5236, GNorm = 0.0001, lr_0 = 9.3032e-04
Validation auc = 0.694238
Epoch 1401
Validation auc = 0.694293
Epoch 1402
Validation auc = 0.694347
Epoch 1403
Validation auc = 0.694347
Epoch 1404
Validation auc = 0.694347
Epoch 1405
Loss = 1.7416e-06, PNorm = 99.5239, GNorm = 0.0000, lr_0 = 9.3008e-04
Loss = 5.0862e-06, PNorm = 99.5240, GNorm = 0.0002, lr_0 = 9.3007e-04
Validation auc = 0.694375
Epoch 1406
Validation auc = 0.694320
Epoch 1407
Validation auc = 0.694320
Epoch 1408
Validation auc = 0.694320
Epoch 1409
Validation auc = 0.694375
Epoch 1410
Loss = 1.1873e-06, PNorm = 99.5242, GNorm = 0.0001, lr_0 = 9.2985e-04
Validation auc = 0.694375
Epoch 1411
Validation auc = 0.694375
Epoch 1412
Validation auc = 0.694375
Epoch 1413
Validation auc = 0.694375
Epoch 1414
Validation auc = 0.694375
Epoch 1415
Loss = 2.8610e-07, PNorm = 99.5245, GNorm = 0.0000, lr_0 = 9.2961e-04
Validation auc = 0.694375
Epoch 1416
Validation auc = 0.694347
Epoch 1417
Validation auc = 0.694375
Epoch 1418
Validation auc = 0.694375
Epoch 1419
Loss = 2.1684e-06, PNorm = 99.5247, GNorm = 0.0000, lr_0 = 9.2939e-04
Loss = 0.0000e+00, PNorm = 99.5248, GNorm = 0.0000, lr_0 = 9.2938e-04
Validation auc = 0.694375
Epoch 1420
Validation auc = 0.694375
Epoch 1421
Validation auc = 0.694375
Epoch 1422
Validation auc = 0.694375
Epoch 1423
Validation auc = 0.694375
Epoch 1424
Loss = 1.8489e-06, PNorm = 99.5250, GNorm = 0.0002, lr_0 = 9.2914e-04
Validation auc = 0.694375
Epoch 1425
Validation auc = 0.694347
Epoch 1426
Validation auc = 0.694347
Epoch 1427
Validation auc = 0.694402
Epoch 1428
Validation auc = 0.694293
Epoch 1429
Loss = 5.5790e-07, PNorm = 99.5255, GNorm = 0.0000, lr_0 = 9.2891e-04
Validation auc = 0.694238
Epoch 1430
Validation auc = 0.694238
Epoch 1431
Validation auc = 0.694183
Epoch 1432
Validation auc = 0.694183
Epoch 1433
Loss = 2.1777e-06, PNorm = 99.5260, GNorm = 0.0000, lr_0 = 9.2868e-04
Validation auc = 0.694183
Epoch 1434
Validation auc = 0.694183
Epoch 1435
Validation auc = 0.694238
Epoch 1436
Validation auc = 0.694238
Epoch 1437
Validation auc = 0.694183
Epoch 1438
Loss = 1.2469e-06, PNorm = 99.5265, GNorm = 0.0001, lr_0 = 9.2845e-04
Loss = 3.3776e-07, PNorm = 99.5265, GNorm = 0.0000, lr_0 = 9.2844e-04
Validation auc = 0.694183
Epoch 1439
Validation auc = 0.694183
Epoch 1440
Validation auc = 0.694183
Epoch 1441
Validation auc = 0.694183
Epoch 1442
Validation auc = 0.694238
Epoch 1443
Loss = 3.2210e-06, PNorm = 99.5270, GNorm = 0.0001, lr_0 = 9.2822e-04
Validation auc = 0.694238
Epoch 1444
Validation auc = 0.694238
Epoch 1445
Validation auc = 0.694238
Epoch 1446
Validation auc = 0.694238
Epoch 1447
Validation auc = 0.694238
Epoch 1448
Loss = 1.9240e-06, PNorm = 99.5275, GNorm = 0.0001, lr_0 = 9.2798e-04
Validation auc = 0.694238
Epoch 1449
Validation auc = 0.694183
Epoch 1450
Validation auc = 0.694183
Epoch 1451
Validation auc = 0.694129
Epoch 1452
Loss = 7.3671e-07, PNorm = 99.5287, GNorm = 0.0001, lr_0 = 9.2776e-04
Loss = 5.9604e-06, PNorm = 99.5288, GNorm = 0.0008, lr_0 = 9.2775e-04
Validation auc = 0.694129
Epoch 1453
Validation auc = 0.694129
Epoch 1454
Validation auc = 0.694074
Epoch 1455
Validation auc = 0.694074
Epoch 1456
Validation auc = 0.694019
Epoch 1457
Loss = 2.1719e-06, PNorm = 99.5295, GNorm = 0.0000, lr_0 = 9.2752e-04
Loss = 7.9473e-08, PNorm = 99.5295, GNorm = 0.0000, lr_0 = 9.2750e-04
Validation auc = 0.693965
Epoch 1458
Validation auc = 0.693965
Epoch 1459
Validation auc = 0.693910
Epoch 1460
Validation auc = 0.693910
Epoch 1461
Validation auc = 0.693965
Epoch 1462
Loss = 2.1648e-06, PNorm = 99.5300, GNorm = 0.0001, lr_0 = 9.2729e-04
Validation auc = 0.694019
Epoch 1463
Validation auc = 0.694074
Epoch 1464
Validation auc = 0.694019
Epoch 1465
Validation auc = 0.694019
Epoch 1466
Loss = 4.0663e-07, PNorm = 99.5304, GNorm = 0.0000, lr_0 = 9.2706e-04
Validation auc = 0.693965
Epoch 1467
Validation auc = 0.693965
Epoch 1468
Validation auc = 0.694019
Epoch 1469
Validation auc = 0.694019
Epoch 1470
Validation auc = 0.693965
Epoch 1471
Loss = 7.3804e-06, PNorm = 99.5309, GNorm = 0.0021, lr_0 = 9.2683e-04
Loss = 0.0000e+00, PNorm = 99.5309, GNorm = 0.0000, lr_0 = 9.2681e-04
Validation auc = 0.693965
Epoch 1472
Validation auc = 0.693965
Epoch 1473
Validation auc = 0.693965
Epoch 1474
Validation auc = 0.693965
Epoch 1475
Validation auc = 0.693965
Epoch 1476
Loss = 1.3471e-06, PNorm = 99.5313, GNorm = 0.0001, lr_0 = 9.2660e-04
Validation auc = 0.693965
Epoch 1477
Validation auc = 0.693965
Epoch 1478
Validation auc = 0.694019
Epoch 1479
Validation auc = 0.694019
Epoch 1480
Validation auc = 0.694183
Epoch 1481
Loss = 4.9829e-07, PNorm = 99.5319, GNorm = 0.0000, lr_0 = 9.2635e-04
Validation auc = 0.694183
Epoch 1482
Validation auc = 0.694183
Epoch 1483
Validation auc = 0.694183
Epoch 1484
Validation auc = 0.694129
Epoch 1485
Loss = 3.3304e-06, PNorm = 99.5325, GNorm = 0.0006, lr_0 = 9.2614e-04
Loss = 3.9736e-08, PNorm = 99.5326, GNorm = 0.0000, lr_0 = 9.2612e-04
Validation auc = 0.694129
Epoch 1486
Validation auc = 0.694129
Epoch 1487
Validation auc = 0.694129
Epoch 1488
Validation auc = 0.694129
Epoch 1489
Validation auc = 0.694457
Epoch 1490
Loss = 6.0745e-06, PNorm = 99.5334, GNorm = 0.0008, lr_0 = 9.2589e-04
Loss = 5.9605e-08, PNorm = 99.5335, GNorm = 0.0000, lr_0 = 9.2587e-04
Validation auc = 0.694347
Epoch 1491
Validation auc = 0.694238
Epoch 1492
Validation auc = 0.694347
Epoch 1493
Validation auc = 0.694457
Epoch 1494
Validation auc = 0.694457
Epoch 1495
Loss = 3.2186e-07, PNorm = 99.5343, GNorm = 0.0000, lr_0 = 9.2566e-04
Validation auc = 0.694402
Epoch 1496
Validation auc = 0.694402
Epoch 1497
Validation auc = 0.694402
Epoch 1498
Validation auc = 0.694457
Epoch 1499
Loss = 5.2717e-06, PNorm = 99.5348, GNorm = 0.0020, lr_0 = 9.2543e-04
Validation auc = 0.694457
Epoch 1500
Validation auc = 0.694457
Epoch 1501
Validation auc = 0.694457
Epoch 1502
Validation auc = 0.694457
Epoch 1503
Validation auc = 0.694457
Epoch 1504
Loss = 1.3602e-06, PNorm = 99.5355, GNorm = 0.0001, lr_0 = 9.2520e-04
Loss = 4.7684e-07, PNorm = 99.5356, GNorm = 0.0000, lr_0 = 9.2518e-04
Validation auc = 0.694566
Epoch 1505
Validation auc = 0.694785
Epoch 1506
Validation auc = 0.694894
Epoch 1507
Validation auc = 0.694949
Epoch 1508
Validation auc = 0.694949
Epoch 1509
Loss = 6.7118e-05, PNorm = 99.5361, GNorm = 0.0025, lr_0 = 9.2497e-04
Validation auc = 0.694949
Epoch 1510
Validation auc = 0.694894
Epoch 1511
Validation auc = 0.694894
Epoch 1512
Validation auc = 0.694839
Epoch 1513
Validation auc = 0.694839
Epoch 1514
Loss = 2.1458e-07, PNorm = 99.5370, GNorm = 0.0000, lr_0 = 9.2472e-04
Validation auc = 0.694867
Epoch 1515
Validation auc = 0.694867
Epoch 1516
Validation auc = 0.694867
Epoch 1517
Validation auc = 0.694894
Epoch 1518
Loss = 5.7034e-06, PNorm = 99.5374, GNorm = 0.0004, lr_0 = 9.2451e-04
Loss = 3.1789e-07, PNorm = 99.5374, GNorm = 0.0000, lr_0 = 9.2449e-04
Validation auc = 0.694867
Epoch 1519
Validation auc = 0.694894
Epoch 1520
Validation auc = 0.694894
Epoch 1521
Validation auc = 0.694894
Epoch 1522
Validation auc = 0.694839
Epoch 1523
Loss = 4.2737e-05, PNorm = 99.5380, GNorm = 0.0001, lr_0 = 9.2427e-04
Loss = 2.9802e-07, PNorm = 99.5382, GNorm = 0.0000, lr_0 = 9.2425e-04
Validation auc = 0.694949
Epoch 1524
Validation auc = 0.695058
Epoch 1525
Validation auc = 0.695058
Epoch 1526
Validation auc = 0.695058
Epoch 1527
Validation auc = 0.695058
Epoch 1528
Loss = 1.5020e-06, PNorm = 99.5390, GNorm = 0.0001, lr_0 = 9.2404e-04
Validation auc = 0.695113
Epoch 1529
Validation auc = 0.695167
Epoch 1530
Validation auc = 0.695167
Epoch 1531
Validation auc = 0.695167
Epoch 1532
Validation auc = 0.695113
Epoch 1533
Loss = 1.2850e-06, PNorm = 99.5395, GNorm = 0.0001, lr_0 = 9.2379e-04
Validation auc = 0.695113
Epoch 1534
Validation auc = 0.695113
Epoch 1535
Validation auc = 0.695113
Epoch 1536
Validation auc = 0.695113
Epoch 1537
Loss = 1.2612e-06, PNorm = 99.5398, GNorm = 0.0000, lr_0 = 9.2358e-04
Loss = 0.0000e+00, PNorm = 99.5398, GNorm = 0.0000, lr_0 = 9.2356e-04
Validation auc = 0.695058
Epoch 1538
Validation auc = 0.695058
Epoch 1539
Validation auc = 0.695058
Epoch 1540
Validation auc = 0.695058
Epoch 1541
Validation auc = 0.695058
Epoch 1542
Loss = 2.0882e-05, PNorm = 99.5402, GNorm = 0.0018, lr_0 = 9.2335e-04
Validation auc = 0.695058
Epoch 1543
Validation auc = 0.695003
Epoch 1544
Validation auc = 0.695003
Epoch 1545
Validation auc = 0.695058
Epoch 1546
Validation auc = 0.695058
Epoch 1547
Loss = 1.1015e-06, PNorm = 99.5405, GNorm = 0.0000, lr_0 = 9.2310e-04
Validation auc = 0.695058
Epoch 1548
Validation auc = 0.695058
Epoch 1549
Validation auc = 0.695058
Epoch 1550
Validation auc = 0.695058
Epoch 1551
Loss = 8.6903e-07, PNorm = 99.5411, GNorm = 0.0000, lr_0 = 9.2289e-04
Loss = 4.1723e-07, PNorm = 99.5411, GNorm = 0.0000, lr_0 = 9.2287e-04
Validation auc = 0.695058
Epoch 1552
Validation auc = 0.695058
Epoch 1553
Validation auc = 0.695003
Epoch 1554
Validation auc = 0.695003
Epoch 1555
Validation auc = 0.695003
Epoch 1556
Loss = 4.2558e-07, PNorm = 99.5418, GNorm = 0.0000, lr_0 = 9.2264e-04
Loss = 1.9868e-08, PNorm = 99.5419, GNorm = 0.0000, lr_0 = 9.2263e-04
Validation auc = 0.695058
Epoch 1557
Validation auc = 0.695003
Epoch 1558
Validation auc = 0.695003
Epoch 1559
Validation auc = 0.697463
Epoch 1560
Validation auc = 0.699650
Epoch 1561
Loss = 1.2530e-05, PNorm = 99.5403, GNorm = 0.0014, lr_0 = 9.2242e-04
Validation auc = 0.700470
Epoch 1562
Validation auc = 0.701673
Epoch 1563
Validation auc = 0.702657
Epoch 1564
Validation auc = 0.703313
Epoch 1565
Validation auc = 0.704270
Epoch 1566
Loss = 2.0837e-06, PNorm = 99.5431, GNorm = 0.0001, lr_0 = 9.2217e-04
Validation auc = 0.704543
Epoch 1567
Validation auc = 0.705090
Epoch 1568
Validation auc = 0.705418
Epoch 1569
Validation auc = 0.705254
Epoch 1570
Loss = 2.4103e-06, PNorm = 99.5468, GNorm = 0.0001, lr_0 = 9.2196e-04
Loss = 8.9407e-07, PNorm = 99.5473, GNorm = 0.0001, lr_0 = 9.2194e-04
Validation auc = 0.705308
Epoch 1571
Validation auc = 0.705363
Epoch 1572
Validation auc = 0.688006
Epoch 1573
Validation auc = 0.709490
Epoch 1574
Validation auc = 0.711021
Epoch 1575
Loss = 1.8146e-01, PNorm = 99.7736, GNorm = 6.4544, lr_0 = 9.2173e-04
Validation auc = 0.693117
Epoch 1576
Validation auc = 0.714465
Epoch 1577
Validation auc = 0.710967
Epoch 1578
Validation auc = 0.711240
Epoch 1579
Validation auc = 0.693199
Epoch 1580
Loss = 2.4451e-01, PNorm = 101.0768, GNorm = 1.1488, lr_0 = 9.2148e-04
Validation auc = 0.727859
Epoch 1581
Validation auc = 0.739121
Epoch 1582
Validation auc = 0.730155
Epoch 1583
Validation auc = 0.733982
Epoch 1584
Loss = 1.1259e-01, PNorm = 102.4280, GNorm = 2.2463, lr_0 = 9.2127e-04
Loss = 5.4566e+00, PNorm = 102.4878, GNorm = 48.5679, lr_0 = 9.2125e-04
Validation auc = 0.724688
Epoch 1585
Validation auc = 0.662530
Epoch 1586
Validation auc = 0.565930
Epoch 1587
Validation auc = 0.551498
Epoch 1588
Validation auc = 0.535917
Epoch 1589
Loss = 3.9941e-01, PNorm = 104.0449, GNorm = 2.3518, lr_0 = 9.2103e-04
Loss = 6.0512e-01, PNorm = 104.1509, GNorm = 3.6128, lr_0 = 9.2101e-04
Validation auc = 0.596654
Epoch 1590
Validation auc = 0.640663
Epoch 1591
Validation auc = 0.716816
Epoch 1592
Validation auc = 0.729335
Epoch 1593
Validation auc = 0.725126
Epoch 1594
Loss = 3.2617e-01, PNorm = 105.4649, GNorm = 4.1386, lr_0 = 9.2080e-04
Validation auc = 0.701290
Epoch 1595
Validation auc = 0.702056
Epoch 1596
Validation auc = 0.683851
Epoch 1597
Validation auc = 0.666576
Epoch 1598
Validation auc = 0.654548
Epoch 1599
Loss = 1.1634e-01, PNorm = 106.5519, GNorm = 2.6473, lr_0 = 9.2055e-04
Validation auc = 0.697573
Epoch 1600
Validation auc = 0.724798
Epoch 1601
Validation auc = 0.710748
Epoch 1602
Validation auc = 0.684288
Epoch 1603
Loss = 9.2206e-02, PNorm = 107.2094, GNorm = 0.5816, lr_0 = 9.2034e-04
Loss = 2.5460e-02, PNorm = 107.2600, GNorm = 0.3135, lr_0 = 9.2032e-04
Validation auc = 0.682484
Epoch 1604
Validation auc = 0.694949
Epoch 1605
Validation auc = 0.703422
Epoch 1606
Validation auc = 0.697026
Epoch 1607
Validation auc = 0.694019
Epoch 1608
Loss = 2.1794e-02, PNorm = 107.8740, GNorm = 0.3300, lr_0 = 9.2010e-04
Validation auc = 0.692762
Epoch 1609
Validation auc = 0.690356
Epoch 1610
Validation auc = 0.690630
Epoch 1611
Validation auc = 0.687404
Epoch 1612
Validation auc = 0.677455
Epoch 1613
Loss = 1.3045e-01, PNorm = 108.2637, GNorm = 2.9314, lr_0 = 9.1987e-04
Validation auc = 0.678329
Epoch 1614
Validation auc = 0.683632
Epoch 1615
Validation auc = 0.701728
Epoch 1616
Validation auc = 0.707522
Epoch 1617
Loss = 1.2638e-01, PNorm = 108.5935, GNorm = 1.3724, lr_0 = 9.1966e-04
Loss = 1.0841e-01, PNorm = 108.6210, GNorm = 1.9284, lr_0 = 9.1964e-04
Validation auc = 0.703969
Epoch 1618
Validation auc = 0.704352
Epoch 1619
Validation auc = 0.709545
Epoch 1620
Validation auc = 0.714575
Epoch 1621
Validation auc = 0.714137
Epoch 1622
Loss = 1.3049e-02, PNorm = 108.9667, GNorm = 0.3562, lr_0 = 9.1941e-04
Loss = 5.0339e-02, PNorm = 108.9863, GNorm = 4.0140, lr_0 = 9.1939e-04
Validation auc = 0.713809
Epoch 1623
Validation auc = 0.710147
Epoch 1624
Validation auc = 0.707468
Epoch 1625
Validation auc = 0.705117
Epoch 1626
Validation auc = 0.703696
Epoch 1627
Loss = 9.3516e-04, PNorm = 109.1775, GNorm = 0.0181, lr_0 = 9.1918e-04
Validation auc = 0.702712
Epoch 1628
Validation auc = 0.700689
Epoch 1629
Validation auc = 0.697791
Epoch 1630
Validation auc = 0.703422
Epoch 1631
Validation auc = 0.707249
Epoch 1632
Loss = 2.4471e-02, PNorm = 109.3362, GNorm = 0.3427, lr_0 = 9.1894e-04
Validation auc = 0.705828
Epoch 1633
Validation auc = 0.708561
Epoch 1634
Validation auc = 0.712005
Epoch 1635
Validation auc = 0.712661
Epoch 1636
Loss = 1.7314e-02, PNorm = 109.5749, GNorm = 0.2096, lr_0 = 9.1873e-04
Loss = 2.7749e-02, PNorm = 109.5910, GNorm = 0.6618, lr_0 = 9.1871e-04
Validation auc = 0.713153
Epoch 1637
Validation auc = 0.708725
Epoch 1638
Validation auc = 0.702712
Epoch 1639
Validation auc = 0.699103
Epoch 1640
Validation auc = 0.695659
Epoch 1641
Loss = 8.0194e-03, PNorm = 109.7958, GNorm = 0.1933, lr_0 = 9.1848e-04
Validation auc = 0.693254
Epoch 1642
Validation auc = 0.690083
Epoch 1643
Validation auc = 0.688006
Epoch 1644
Validation auc = 0.684507
Epoch 1645
Validation auc = 0.681172
Epoch 1646
Loss = 1.9814e-03, PNorm = 109.9142, GNorm = 0.1185, lr_0 = 9.1825e-04
Validation auc = 0.679313
Epoch 1647
Validation auc = 0.678439
Epoch 1648
Validation auc = 0.679040
Epoch 1649
Validation auc = 0.678493
Epoch 1650
Loss = 3.8647e-03, PNorm = 109.9709, GNorm = 0.2127, lr_0 = 9.1804e-04
Loss = 5.2253e-06, PNorm = 109.9736, GNorm = 0.0002, lr_0 = 9.1803e-04
Validation auc = 0.679860
Epoch 1651
Validation auc = 0.680243
Epoch 1652
Validation auc = 0.681336
Epoch 1653
Validation auc = 0.670402
Epoch 1654
Validation auc = 0.658266
Epoch 1655
Loss = 3.6583e-02, PNorm = 110.0159, GNorm = 4.9713, lr_0 = 9.1780e-04
Loss = 5.3311e-03, PNorm = 110.0236, GNorm = 0.4226, lr_0 = 9.1778e-04
Validation auc = 0.707413
Epoch 1656
Validation auc = 0.723923
Epoch 1657
Validation auc = 0.724880
Epoch 1658
Validation auc = 0.715668
Epoch 1659
Validation auc = 0.703969
Epoch 1660
Loss = 4.1174e-02, PNorm = 110.1306, GNorm = 1.6590, lr_0 = 9.1757e-04
Validation auc = 0.703477
Epoch 1661
Validation auc = 0.702985
Epoch 1662
Validation auc = 0.703422
Epoch 1663
Validation auc = 0.704188
Epoch 1664
Validation auc = 0.702876
Epoch 1665
Loss = 1.1239e-02, PNorm = 110.2488, GNorm = 1.5165, lr_0 = 9.1733e-04
Validation auc = 0.703914
Epoch 1666
Validation auc = 0.707905
Epoch 1667
Validation auc = 0.710256
Epoch 1668
Validation auc = 0.708616
Epoch 1669
Loss = 5.5438e-02, PNorm = 110.3960, GNorm = 2.1509, lr_0 = 9.1712e-04
Loss = 5.4581e-03, PNorm = 110.4073, GNorm = 0.3437, lr_0 = 9.1710e-04
Validation auc = 0.710584
Epoch 1670
Validation auc = 0.717253
Epoch 1671
Validation auc = 0.720588
Epoch 1672
Validation auc = 0.720862
Epoch 1673
Validation auc = 0.718729
Epoch 1674
Loss = 2.7568e-03, PNorm = 110.5363, GNorm = 0.1328, lr_0 = 9.1687e-04
Validation auc = 0.718729
Epoch 1675
Validation auc = 0.717144
Epoch 1676
Validation auc = 0.719987
Epoch 1677
Validation auc = 0.720588
Epoch 1678
Validation auc = 0.711240
Epoch 1679
Loss = 2.2362e-02, PNorm = 110.7053, GNorm = 0.7431, lr_0 = 9.1664e-04
Validation auc = 0.709600
Epoch 1680
Validation auc = 0.708780
Epoch 1681
Validation auc = 0.706429
Epoch 1682
Validation auc = 0.702056
Epoch 1683
Loss = 2.3282e-01, PNorm = 111.0297, GNorm = 8.4881, lr_0 = 9.1642e-04
Validation auc = 0.693637
Epoch 1684
Validation auc = 0.684562
Epoch 1685
Validation auc = 0.683906
Epoch 1686
Validation auc = 0.692434
Epoch 1687
Validation auc = 0.703532
Epoch 1688
Loss = 1.0724e-01, PNorm = 111.4022, GNorm = 1.1057, lr_0 = 9.1619e-04
Loss = 3.7582e-02, PNorm = 111.4281, GNorm = 1.6176, lr_0 = 9.1617e-04
Validation auc = 0.719604
Epoch 1689
Validation auc = 0.713645
Epoch 1690
Validation auc = 0.711951
Epoch 1691
Validation auc = 0.701454
Epoch 1692
Validation auc = 0.688279
Epoch 1693
Loss = 2.6776e-02, PNorm = 111.7099, GNorm = 1.4133, lr_0 = 9.1596e-04
Validation auc = 0.683496
Epoch 1694
Validation auc = 0.684917
Epoch 1695
Validation auc = 0.690438
Epoch 1696
Validation auc = 0.694675
Epoch 1697
Validation auc = 0.698283
Epoch 1698
Loss = 1.2971e-03, PNorm = 111.9635, GNorm = 0.0436, lr_0 = 9.1572e-04
Validation auc = 0.698693
Epoch 1699
Validation auc = 0.702520
Epoch 1700
Validation auc = 0.707796
Epoch 1701
Validation auc = 0.706866
Epoch 1702
Loss = 1.5694e-02, PNorm = 112.0944, GNorm = 2.7477, lr_0 = 9.1551e-04
Loss = 1.7674e-04, PNorm = 112.1028, GNorm = 0.0074, lr_0 = 9.1549e-04
Validation auc = 0.707522
Epoch 1703
Validation auc = 0.717199
Epoch 1704
Validation auc = 0.716543
Epoch 1705
Validation auc = 0.713645
Epoch 1706
Validation auc = 0.712497
Epoch 1707
Loss = 1.2417e-02, PNorm = 112.2139, GNorm = 1.3030, lr_0 = 9.1526e-04
Loss = 9.7513e-05, PNorm = 112.2212, GNorm = 0.0118, lr_0 = 9.1525e-04
Validation auc = 0.711185
Epoch 1708
Validation auc = 0.708124
Epoch 1709
Validation auc = 0.702165
Epoch 1710
Validation auc = 0.694074
Epoch 1711
Validation auc = 0.690028
Epoch 1712
Loss = 1.2170e-02, PNorm = 112.2944, GNorm = 0.3403, lr_0 = 9.1504e-04
Validation auc = 0.686748
Epoch 1713
Validation auc = 0.684234
Epoch 1714
Validation auc = 0.684015
Epoch 1715
Validation auc = 0.686803
Epoch 1716
Loss = 2.7859e-03, PNorm = 112.4102, GNorm = 0.0057, lr_0 = 9.1481e-04
Validation auc = 0.691012
Epoch 1717
Validation auc = 0.695167
Epoch 1718
Validation auc = 0.701618
Epoch 1719
Validation auc = 0.708342
Epoch 1720
Validation auc = 0.715012
Epoch 1721
Loss = 8.2750e-03, PNorm = 112.5347, GNorm = 0.5983, lr_0 = 9.1458e-04
Loss = 2.7445e-04, PNorm = 112.5432, GNorm = 0.0087, lr_0 = 9.1457e-04
Validation auc = 0.717855
Epoch 1722
Validation auc = 0.722174
Epoch 1723
Validation auc = 0.723595
Epoch 1724
Validation auc = 0.720588
Epoch 1725
Validation auc = 0.718511
Epoch 1726
Loss = 3.6098e-02, PNorm = 112.6103, GNorm = 1.6640, lr_0 = 9.1436e-04
Validation auc = 0.716215
Epoch 1727
Validation auc = 0.717581
Epoch 1728
Validation auc = 0.717636
Epoch 1729
Validation auc = 0.717527
Epoch 1730
Validation auc = 0.718620
Epoch 1731
Loss = 1.6038e-03, PNorm = 112.6809, GNorm = 0.0392, lr_0 = 9.1411e-04
Validation auc = 0.718675
Epoch 1732
Validation auc = 0.723158
Epoch 1733
Validation auc = 0.725672
Epoch 1734
Validation auc = 0.727312
Epoch 1735
Loss = 1.5917e-03, PNorm = 112.7442, GNorm = 0.1545, lr_0 = 9.1390e-04
Loss = 5.3031e-04, PNorm = 112.7482, GNorm = 0.0319, lr_0 = 9.1389e-04
Validation auc = 0.728898
Epoch 1736
Validation auc = 0.730975
Epoch 1737
Validation auc = 0.732287
Epoch 1738
Validation auc = 0.731905
Epoch 1739
Validation auc = 0.736661
Epoch 1740
Loss = 3.8806e-03, PNorm = 112.7938, GNorm = 0.4899, lr_0 = 9.1366e-04
Loss = 9.7731e-03, PNorm = 112.7971, GNorm = 0.4684, lr_0 = 9.1364e-04
Validation auc = 0.742018
Epoch 1741
Validation auc = 0.744806
Epoch 1742
Validation auc = 0.736169
Epoch 1743
Validation auc = 0.734857
Epoch 1744
Validation auc = 0.732615
Epoch 1745
Loss = 7.4729e-02, PNorm = 112.8493, GNorm = 0.6799, lr_0 = 9.1343e-04
Validation auc = 0.727640
Epoch 1746
Validation auc = 0.721518
Epoch 1747
Validation auc = 0.714301
Epoch 1748
Validation auc = 0.711295
Epoch 1749
Loss = 1.6981e-02, PNorm = 113.0078, GNorm = 0.1131, lr_0 = 9.1320e-04
Validation auc = 0.709436
Epoch 1750
Validation auc = 0.710037
Epoch 1751
Validation auc = 0.708452
Epoch 1752
Validation auc = 0.707030
Epoch 1753
Validation auc = 0.707140
Epoch 1754
Loss = 5.7382e-04, PNorm = 113.1792, GNorm = 0.0183, lr_0 = 9.1298e-04
Loss = 1.4712e-02, PNorm = 113.1903, GNorm = 0.9089, lr_0 = 9.1296e-04
Validation auc = 0.707522
Epoch 1755
Validation auc = 0.707741
Epoch 1756
Validation auc = 0.707632
Epoch 1757
Validation auc = 0.716925
Epoch 1758
Validation auc = 0.720807
Epoch 1759
Loss = 3.6224e-03, PNorm = 113.3066, GNorm = 0.1156, lr_0 = 9.1275e-04
Validation auc = 0.722720
Epoch 1760
Validation auc = 0.723978
Epoch 1761
Validation auc = 0.723868
Epoch 1762
Validation auc = 0.725180
Epoch 1763
Validation auc = 0.725454
Epoch 1764
Loss = 1.7118e-01, PNorm = 113.4402, GNorm = 0.9215, lr_0 = 9.1251e-04
Validation auc = 0.724634
Epoch 1765
Validation auc = 0.722884
Epoch 1766
Validation auc = 0.720698
Epoch 1767
Validation auc = 0.719932
Epoch 1768
Loss = 3.6181e-03, PNorm = 113.4957, GNorm = 0.0858, lr_0 = 9.1230e-04
Loss = 4.8948e-03, PNorm = 113.5016, GNorm = 0.1886, lr_0 = 9.1228e-04
Validation auc = 0.719003
Epoch 1769
Validation auc = 0.718784
Epoch 1770
Validation auc = 0.719440
Epoch 1771
Validation auc = 0.720206
Epoch 1772
Validation auc = 0.721080
Epoch 1773
Loss = 4.9319e-04, PNorm = 113.5724, GNorm = 0.0191, lr_0 = 9.1206e-04
Loss = 2.8418e-03, PNorm = 113.5767, GNorm = 0.1871, lr_0 = 9.1204e-04
Validation auc = 0.721955
Epoch 1774
Validation auc = 0.724087
Epoch 1775
Validation auc = 0.726164
Epoch 1776
Validation auc = 0.726930
Epoch 1777
Validation auc = 0.728406
Epoch 1778
Loss = 7.9452e-04, PNorm = 113.6141, GNorm = 0.0349, lr_0 = 9.1183e-04
Validation auc = 0.729554
Epoch 1779
Validation auc = 0.729827
Epoch 1780
Validation auc = 0.729609
Epoch 1781
Validation auc = 0.730046
Epoch 1782
Validation auc = 0.729117
Epoch 1783
Loss = 2.0082e-04, PNorm = 113.6517, GNorm = 0.0082, lr_0 = 9.1159e-04
Validation auc = 0.729007
Epoch 1784
Validation auc = 0.721900
Epoch 1785
Validation auc = 0.723322
Epoch 1786
Validation auc = 0.733107
Epoch 1787
Loss = 4.0077e-02, PNorm = 113.7237, GNorm = 0.0389, lr_0 = 9.1138e-04
Loss = 1.2460e-03, PNorm = 113.7318, GNorm = 0.0436, lr_0 = 9.1136e-04
Validation auc = 0.735895
Epoch 1788
Validation auc = 0.732998
Epoch 1789
Validation auc = 0.732069
Epoch 1790
Validation auc = 0.729991
Epoch 1791
Validation auc = 0.730757
Epoch 1792
Loss = 7.7078e-02, PNorm = 113.8322, GNorm = 1.4963, lr_0 = 9.1115e-04
Validation auc = 0.729554
Epoch 1793
Validation auc = 0.727695
Epoch 1794
Validation auc = 0.726930
Epoch 1795
Validation auc = 0.727312
Epoch 1796
Validation auc = 0.729718
Epoch 1797
Loss = 2.3343e-03, PNorm = 113.9228, GNorm = 0.0453, lr_0 = 9.1091e-04
Validation auc = 0.732779
Epoch 1798
Validation auc = 0.733217
Epoch 1799
Validation auc = 0.732725
Epoch 1800
Validation auc = 0.732506
Epoch 1801
Loss = 2.2116e-02, PNorm = 113.9558, GNorm = 1.4420, lr_0 = 9.1070e-04
Loss = 1.3894e-03, PNorm = 113.9598, GNorm = 0.0450, lr_0 = 9.1068e-04
Validation auc = 0.735731
Epoch 1802
Validation auc = 0.737208
Epoch 1803
Validation auc = 0.737317
Epoch 1804
Validation auc = 0.738246
Epoch 1805
Validation auc = 0.738465
Epoch 1806
Loss = 5.8630e-02, PNorm = 114.0335, GNorm = 0.0564, lr_0 = 9.1046e-04
Loss = 1.1026e-02, PNorm = 114.0390, GNorm = 0.4780, lr_0 = 9.1044e-04
Validation auc = 0.739285
Epoch 1807
Validation auc = 0.739176
Epoch 1808
Validation auc = 0.737700
Epoch 1809
Validation auc = 0.736606
Epoch 1810
Validation auc = 0.736223
Epoch 1811
Loss = 3.2141e-04, PNorm = 114.0990, GNorm = 0.0070, lr_0 = 9.1023e-04
Validation auc = 0.730265
Epoch 1812
Validation auc = 0.723759
Epoch 1813
Validation auc = 0.724524
Epoch 1814
Validation auc = 0.730811
Epoch 1815
Validation auc = 0.736825
Epoch 1816
Loss = 3.7218e-02, PNorm = 114.1439, GNorm = 1.3745, lr_0 = 9.0999e-04
Validation auc = 0.742620
Epoch 1817
Validation auc = 0.743440
Epoch 1818
Validation auc = 0.742729
Epoch 1819
Validation auc = 0.737153
Epoch 1820
Loss = 1.1628e-02, PNorm = 114.1975, GNorm = 0.2832, lr_0 = 9.0978e-04
Loss = 1.2310e-02, PNorm = 114.2019, GNorm = 0.5139, lr_0 = 9.0976e-04
Validation auc = 0.735130
Epoch 1821
Validation auc = 0.733490
Epoch 1822
Validation auc = 0.732725
Epoch 1823
Validation auc = 0.732506
Epoch 1824
Validation auc = 0.732615
Epoch 1825
Loss = 1.0490e-03, PNorm = 114.2493, GNorm = 0.0248, lr_0 = 9.0955e-04
Validation auc = 0.732561
Epoch 1826
Validation auc = 0.732834
Epoch 1827
Validation auc = 0.732779
Epoch 1828
Validation auc = 0.730647
Epoch 1829
Validation auc = 0.729171
Epoch 1830
Loss = 8.9712e-03, PNorm = 114.2836, GNorm = 0.4739, lr_0 = 9.0931e-04
Validation auc = 0.728133
Epoch 1831
Validation auc = 0.727476
Epoch 1832
Validation auc = 0.726547
Epoch 1833
Validation auc = 0.725836
Epoch 1834
Loss = 1.8827e-03, PNorm = 114.3144, GNorm = 0.0178, lr_0 = 9.0910e-04
Loss = 9.1988e-06, PNorm = 114.3165, GNorm = 0.0005, lr_0 = 9.0909e-04
Validation auc = 0.726055
Epoch 1835
Validation auc = 0.721026
Epoch 1836
Validation auc = 0.717527
Epoch 1837
Validation auc = 0.718620
Epoch 1838
Validation auc = 0.720206
Epoch 1839
Loss = 1.1814e-02, PNorm = 114.3341, GNorm = 0.0286, lr_0 = 9.0886e-04
Loss = 3.5619e-04, PNorm = 114.3357, GNorm = 0.0143, lr_0 = 9.0884e-04
Validation auc = 0.725016
Epoch 1840
Validation auc = 0.727422
Epoch 1841
Validation auc = 0.728679
Epoch 1842
Validation auc = 0.729718
Epoch 1843
Validation auc = 0.731139
Epoch 1844
Loss = 1.2972e-03, PNorm = 114.3554, GNorm = 0.0482, lr_0 = 9.0863e-04
Validation auc = 0.725946
Epoch 1845
Validation auc = 0.722556
Epoch 1846
Validation auc = 0.720807
Epoch 1847
Validation auc = 0.720206
Epoch 1848
Validation auc = 0.719604
Epoch 1849
Loss = 4.2489e-04, PNorm = 114.3734, GNorm = 0.0104, lr_0 = 9.0839e-04
Validation auc = 0.718456
Epoch 1850
Validation auc = 0.718292
Epoch 1851
Validation auc = 0.717800
Epoch 1852
Validation auc = 0.717909
Epoch 1853
Loss = 2.8046e-03, PNorm = 114.4181, GNorm = 0.0330, lr_0 = 9.0818e-04
Loss = 2.0348e-02, PNorm = 114.4232, GNorm = 1.9479, lr_0 = 9.0817e-04
Validation auc = 0.716160
Epoch 1854
Validation auc = 0.711732
Epoch 1855
Validation auc = 0.707632
Epoch 1856
Validation auc = 0.705609
Epoch 1857
Validation auc = 0.702602
Epoch 1858
Loss = 1.4975e-04, PNorm = 114.4786, GNorm = 0.0012, lr_0 = 9.0794e-04
Validation auc = 0.702056
Epoch 1859
Validation auc = 0.701564
Epoch 1860
Validation auc = 0.702001
Epoch 1861
Validation auc = 0.701454
Epoch 1862
Validation auc = 0.701892
Epoch 1863
Loss = 7.0931e-04, PNorm = 114.5046, GNorm = 0.0177, lr_0 = 9.0772e-04
Validation auc = 0.702220
Epoch 1864
Validation auc = 0.702220
Epoch 1865
Validation auc = 0.702220
Epoch 1866
Validation auc = 0.702274
Epoch 1867
Loss = 7.3331e-05, PNorm = 114.5189, GNorm = 0.0012, lr_0 = 9.0751e-04
Loss = 3.1231e-05, PNorm = 114.5197, GNorm = 0.0013, lr_0 = 9.0749e-04
Validation auc = 0.702384
Epoch 1868
Validation auc = 0.702548
Epoch 1869
Validation auc = 0.702985
Epoch 1870
Validation auc = 0.702930
Epoch 1871
Validation auc = 0.703204
Epoch 1872
Loss = 1.8009e-04, PNorm = 114.5292, GNorm = 0.0232, lr_0 = 9.0727e-04
Loss = 1.0292e-04, PNorm = 114.5297, GNorm = 0.0039, lr_0 = 9.0725e-04
Validation auc = 0.703422
Epoch 1873
Validation auc = 0.703313
Epoch 1874
Validation auc = 0.707850
Epoch 1875
Validation auc = 0.713755
Epoch 1876
Validation auc = 0.715012
Epoch 1877
Loss = 2.0652e-04, PNorm = 114.5476, GNorm = 0.0189, lr_0 = 9.0704e-04
Validation auc = 0.720534
Epoch 1878
Validation auc = 0.715887
Epoch 1879
Validation auc = 0.702657
Epoch 1880
Validation auc = 0.696097
Epoch 1881
Validation auc = 0.698393
Epoch 1882
Loss = 9.1378e-02, PNorm = 115.0392, GNorm = 0.9138, lr_0 = 9.0680e-04
Validation auc = 0.700798
Epoch 1883
Validation auc = 0.705554
Epoch 1884
Validation auc = 0.708616
Epoch 1885
Validation auc = 0.706648
Epoch 1886
Loss = 3.6773e-02, PNorm = 115.4822, GNorm = 0.3943, lr_0 = 9.0659e-04
Loss = 1.5341e-01, PNorm = 115.5118, GNorm = 7.0109, lr_0 = 9.0657e-04
Validation auc = 0.706538
Epoch 1887
Validation auc = 0.704570
Epoch 1888
Validation auc = 0.701400
Epoch 1889
Validation auc = 0.697737
Epoch 1890
Validation auc = 0.693418
Epoch 1891
Loss = 2.2481e-01, PNorm = 115.8969, GNorm = 1.7846, lr_0 = 9.0635e-04
Validation auc = 0.692817
Epoch 1892
Validation auc = 0.691887
Epoch 1893
Validation auc = 0.682156
Epoch 1894
Validation auc = 0.679040
Epoch 1895
Validation auc = 0.674940
Epoch 1896
Loss = 6.2689e-03, PNorm = 116.1225, GNorm = 0.1754, lr_0 = 9.0612e-04
Validation auc = 0.669692
Epoch 1897
Validation auc = 0.667396
Epoch 1898
Validation auc = 0.661218
Epoch 1899
Validation auc = 0.656079
Epoch 1900
Loss = 4.1044e-03, PNorm = 116.3003, GNorm = 0.0799, lr_0 = 9.0592e-04
Loss = 3.9974e-04, PNorm = 116.3110, GNorm = 0.0154, lr_0 = 9.0590e-04
Validation auc = 0.654767
Epoch 1901
Validation auc = 0.655970
Epoch 1902
Validation auc = 0.670621
Epoch 1903
Validation auc = 0.675104
Epoch 1904
Validation auc = 0.676853
Epoch 1905
Loss = 9.8906e-03, PNorm = 116.4656, GNorm = 0.2465, lr_0 = 9.0567e-04
Loss = 3.9731e-04, PNorm = 116.4774, GNorm = 0.0298, lr_0 = 9.0566e-04
Validation auc = 0.677564
Epoch 1906
Validation auc = 0.678111
Epoch 1907
Validation auc = 0.679040
Epoch 1908
Validation auc = 0.681992
Epoch 1909
Validation auc = 0.683523
Epoch 1910
Loss = 1.8554e-02, PNorm = 116.5877, GNorm = 0.9363, lr_0 = 9.0545e-04
Validation auc = 0.684288
Epoch 1911
Validation auc = 0.685327
Epoch 1912
Validation auc = 0.686912
Epoch 1913
Validation auc = 0.690630
Epoch 1914
Validation auc = 0.694129
Epoch 1915
Loss = 1.0188e-01, PNorm = 116.6849, GNorm = 5.1057, lr_0 = 9.0521e-04
Validation auc = 0.687514
Epoch 1916
Validation auc = 0.684288
Epoch 1917
Validation auc = 0.684835
Epoch 1918
Validation auc = 0.682539
Epoch 1919
Loss = 1.7564e-02, PNorm = 116.9234, GNorm = 0.9492, lr_0 = 9.0500e-04
Loss = 5.8270e-04, PNorm = 116.9390, GNorm = 0.0266, lr_0 = 9.0498e-04
Validation auc = 0.683414
Epoch 1920
Validation auc = 0.687350
Epoch 1921
Validation auc = 0.692543
Epoch 1922
Validation auc = 0.687295
Epoch 1923
Validation auc = 0.685983
Epoch 1924
Loss = 4.4159e-02, PNorm = 117.2053, GNorm = 0.7567, lr_0 = 9.0476e-04
Validation auc = 0.691668
Epoch 1925
Validation auc = 0.699431
Epoch 1926
Validation auc = 0.710748
Epoch 1927
Validation auc = 0.713427
Epoch 1928
Validation auc = 0.718401
Epoch 1929
Loss = 7.8591e-02, PNorm = 117.4337, GNorm = 1.0920, lr_0 = 9.0454e-04
Validation auc = 0.722064
Epoch 1930
Validation auc = 0.722720
Epoch 1931
Validation auc = 0.721900
Epoch 1932
Validation auc = 0.719823
Epoch 1933
Loss = 1.4984e-02, PNorm = 117.6236, GNorm = 0.0414, lr_0 = 9.0431e-04
Validation auc = 0.719604
Epoch 1934
Validation auc = 0.719440
Epoch 1935
Validation auc = 0.719440
Epoch 1936
Validation auc = 0.719768
Epoch 1937
Validation auc = 0.718784
Epoch 1938
Loss = 5.0914e-03, PNorm = 117.7092, GNorm = 0.1077, lr_0 = 9.0409e-04
Loss = 2.1686e-03, PNorm = 117.7123, GNorm = 0.0666, lr_0 = 9.0407e-04
Validation auc = 0.718183
Epoch 1939
Validation auc = 0.718401
Epoch 1940
Validation auc = 0.718401
Epoch 1941
Validation auc = 0.719003
Epoch 1942
Validation auc = 0.720206
Epoch 1943
Loss = 3.8925e-03, PNorm = 117.7431, GNorm = 0.0933, lr_0 = 9.0386e-04
Validation auc = 0.722064
Epoch 1944
Validation auc = 0.722447
Epoch 1945
Validation auc = 0.719440
Epoch 1946
Validation auc = 0.718347
Epoch 1947
Validation auc = 0.717855
Epoch 1948
Loss = 7.8166e-04, PNorm = 117.7768, GNorm = 0.0153, lr_0 = 9.0362e-04
Validation auc = 0.718784
Epoch 1949
Validation auc = 0.719386
Epoch 1950
Validation auc = 0.719932
Epoch 1951
Validation auc = 0.720315
Epoch 1952
Loss = 2.0801e-04, PNorm = 117.8023, GNorm = 0.0062, lr_0 = 9.0341e-04
Loss = 8.4778e-05, PNorm = 117.8036, GNorm = 0.0050, lr_0 = 9.0340e-04
Validation auc = 0.720096
Epoch 1953
Validation auc = 0.720096
Epoch 1954
Validation auc = 0.720479
Epoch 1955
Validation auc = 0.720534
Epoch 1956
Validation auc = 0.720588
Epoch 1957
Loss = 1.4372e-04, PNorm = 117.8184, GNorm = 0.0030, lr_0 = 9.0317e-04
Loss = 3.6160e-06, PNorm = 117.8191, GNorm = 0.0002, lr_0 = 9.0316e-04
Validation auc = 0.720698
Epoch 1958
Validation auc = 0.721026
Epoch 1959
Validation auc = 0.721135
Epoch 1960
Validation auc = 0.721408
Epoch 1961
Validation auc = 0.721572
Epoch 1962
Loss = 6.0908e-05, PNorm = 117.8264, GNorm = 0.0018, lr_0 = 9.0295e-04
Validation auc = 0.721463
Epoch 1963
Validation auc = 0.724306
Epoch 1964
Validation auc = 0.723267
Epoch 1965
Validation auc = 0.719276
Epoch 1966
Loss = 7.6805e-04, PNorm = 117.8969, GNorm = 0.0796, lr_0 = 9.0273e-04
Validation auc = 0.716215
Epoch 1967
Validation auc = 0.713919
Epoch 1968
Validation auc = 0.717253
Epoch 1969
Validation auc = 0.722338
Epoch 1970
Validation auc = 0.725016
Epoch 1971
Loss = 4.7648e-03, PNorm = 118.0389, GNorm = 0.1684, lr_0 = 9.0250e-04
Loss = 1.6382e-04, PNorm = 118.0484, GNorm = 0.0053, lr_0 = 9.0249e-04
Validation auc = 0.728406
Epoch 1972
Validation auc = 0.734747
Epoch 1973
Validation auc = 0.736005
Epoch 1974
Validation auc = 0.735622
Epoch 1975
Validation auc = 0.734201
Epoch 1976
Loss = 5.7766e-03, PNorm = 118.1654, GNorm = 0.1170, lr_0 = 9.0228e-04
Validation auc = 0.733654
Epoch 1977
Validation auc = 0.729937
Epoch 1978
Validation auc = 0.727805
Epoch 1979
Validation auc = 0.725672
Epoch 1980
Validation auc = 0.724470
Epoch 1981
Loss = 1.3895e-03, PNorm = 118.2510, GNorm = 0.0288, lr_0 = 9.0204e-04
Validation auc = 0.723978
Epoch 1982
Validation auc = 0.723814
Epoch 1983
Validation auc = 0.722884
Epoch 1984
Validation auc = 0.722228
Epoch 1985
Loss = 7.5793e-04, PNorm = 118.3009, GNorm = 0.0414, lr_0 = 9.0183e-04
Loss = 1.4509e-04, PNorm = 118.3041, GNorm = 0.0044, lr_0 = 9.0181e-04
Validation auc = 0.721846
Epoch 1986
Validation auc = 0.721463
Epoch 1987
Validation auc = 0.721463
Epoch 1988
Validation auc = 0.721736
Epoch 1989
Validation auc = 0.721764
Epoch 1990
Loss = 2.2975e-02, PNorm = 118.3368, GNorm = 1.8638, lr_0 = 9.0159e-04
Loss = 3.7153e-04, PNorm = 118.3380, GNorm = 0.0199, lr_0 = 9.0157e-04
Validation auc = 0.721354
Epoch 1991
Validation auc = 0.721572
Epoch 1992
Validation auc = 0.724306
Epoch 1993
Validation auc = 0.726602
Epoch 1994
Validation auc = 0.727094
Epoch 1995
Loss = 1.2827e-03, PNorm = 118.3949, GNorm = 0.0698, lr_0 = 9.0137e-04
Validation auc = 0.726219
Epoch 1996
Validation auc = 0.726055
Epoch 1997
Validation auc = 0.726164
Epoch 1998
Validation auc = 0.725180
Epoch 1999
Loss = 1.4913e-04, PNorm = 118.4697, GNorm = 0.0047, lr_0 = 9.0114e-04
Validation auc = 0.725180
Model 0 best validation auc = 0.745353 on epoch 591
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.618687
Ensemble test auc = 0.618687
Fold 1
Splitting data with seed 1
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.545539
Epoch 1
Validation auc = 0.681828
Epoch 2
Validation auc = 0.388257
Epoch 3
Validation auc = 0.676908
Epoch 4
Loss = 7.3376e-01, PNorm = 71.6135, GNorm = 3.1526, lr_0 = 2.0385e-04
Loss = 6.3376e-01, PNorm = 71.6147, GNorm = 2.4868, lr_0 = 2.1077e-04
Validation auc = 0.451782
Epoch 5
Validation auc = 0.647113
Epoch 6
Validation auc = 0.630713
Epoch 7
Validation auc = 0.523672
Epoch 8
Validation auc = 0.599169
Epoch 9
Loss = 6.9975e-01, PNorm = 71.6370, GNorm = 0.9004, lr_0 = 3.0077e-04
Validation auc = 0.657173
Epoch 10
Validation auc = 0.636781
Epoch 11
Validation auc = 0.692598
Epoch 12
Validation auc = 0.627323
Epoch 13
Validation auc = 0.688060
Epoch 14
Loss = 7.2664e-01, PNorm = 71.6789, GNorm = 2.0921, lr_0 = 4.0462e-04
Validation auc = 0.650667
Epoch 15
Validation auc = 0.655696
Epoch 16
Validation auc = 0.640007
Epoch 17
Validation auc = 0.648098
Epoch 18
Loss = 6.7376e-01, PNorm = 71.7311, GNorm = 0.5979, lr_0 = 4.9462e-04
Loss = 7.3170e-01, PNorm = 71.7352, GNorm = 2.2903, lr_0 = 5.0154e-04
Validation auc = 0.663405
Epoch 19
Validation auc = 0.655587
Epoch 20
Validation auc = 0.650995
Epoch 21
Validation auc = 0.630166
Epoch 22
Validation auc = 0.618740
Epoch 23
Loss = 6.3994e-01, PNorm = 71.8133, GNorm = 1.2750, lr_0 = 5.9846e-04
Loss = 5.7115e-01, PNorm = 71.8209, GNorm = 2.2113, lr_0 = 6.0538e-04
Validation auc = 0.596654
Epoch 24
Validation auc = 0.625629
Epoch 25
Validation auc = 0.634649
Epoch 26
Validation auc = 0.665592
Epoch 27
Validation auc = 0.655150
Epoch 28
Loss = 5.8511e-01, PNorm = 71.9215, GNorm = 0.8078, lr_0 = 6.9538e-04
Validation auc = 0.668161
Epoch 29
Validation auc = 0.669254
Epoch 30
Validation auc = 0.665154
Epoch 31
Validation auc = 0.652471
Epoch 32
Validation auc = 0.638695
Epoch 33
Loss = 6.0119e-01, PNorm = 72.0596, GNorm = 0.6416, lr_0 = 7.9923e-04
Validation auc = 0.601246
Epoch 34
Validation auc = 0.564892
Epoch 35
Validation auc = 0.627487
Epoch 36
Validation auc = 0.611360
Epoch 37
Loss = 7.5944e-01, PNorm = 72.1992, GNorm = 1.8133, lr_0 = 8.8923e-04
Loss = 5.8037e-01, PNorm = 72.2080, GNorm = 0.7181, lr_0 = 8.9615e-04
Validation auc = 0.645637
Epoch 38
Validation auc = 0.640116
Epoch 39
Validation auc = 0.626339
Epoch 40
Validation auc = 0.635524
Epoch 41
Validation auc = 0.645200
Epoch 42
Loss = 6.8914e-01, PNorm = 72.3523, GNorm = 0.3052, lr_0 = 9.8615e-04
Validation auc = 0.647934
Epoch 43
Validation auc = 0.652307
Epoch 44
Validation auc = 0.647770
Epoch 45
Validation auc = 0.631260
Epoch 46
Validation auc = 0.619779
Epoch 47
Loss = 7.1026e-01, PNorm = 72.5481, GNorm = 1.5207, lr_0 = 9.9977e-04
Validation auc = 0.628143
Epoch 48
Validation auc = 0.628690
Epoch 49
Validation auc = 0.618795
Epoch 50
Validation auc = 0.619834
Epoch 51
Loss = 5.6523e-01, PNorm = 72.7685, GNorm = 1.7092, lr_0 = 9.9954e-04
Loss = 2.9097e-01, PNorm = 72.7865, GNorm = 1.1232, lr_0 = 9.9952e-04
Validation auc = 0.613164
Epoch 52
Validation auc = 0.608353
Epoch 53
Validation auc = 0.542532
Epoch 54
Validation auc = 0.556418
Epoch 55
Validation auc = 0.588618
Epoch 56
Loss = 6.2518e-01, PNorm = 73.0196, GNorm = 0.3003, lr_0 = 9.9927e-04
Loss = 5.5173e-01, PNorm = 73.0419, GNorm = 0.9219, lr_0 = 9.9926e-04
Validation auc = 0.588126
Epoch 57
Validation auc = 0.592991
Epoch 58
Validation auc = 0.598240
Epoch 59
Validation auc = 0.609993
Epoch 60
Validation auc = 0.628963
Epoch 61
Loss = 5.2418e-01, PNorm = 73.2752, GNorm = 0.7193, lr_0 = 9.9903e-04
Validation auc = 0.637656
Epoch 62
Validation auc = 0.640717
Epoch 63
Validation auc = 0.636180
Epoch 64
Validation auc = 0.641811
Epoch 65
Validation auc = 0.642248
Epoch 66
Loss = 5.5469e-01, PNorm = 73.5681, GNorm = 1.4202, lr_0 = 9.9876e-04
Validation auc = 0.638968
Epoch 67
Validation auc = 0.630221
Epoch 68
Validation auc = 0.620380
Epoch 69
Validation auc = 0.616226
Epoch 70
Loss = 5.3497e-01, PNorm = 73.8163, GNorm = 0.3914, lr_0 = 9.9853e-04
Loss = 4.0339e-01, PNorm = 73.8400, GNorm = 0.8526, lr_0 = 9.9851e-04
Validation auc = 0.598076
Epoch 71
Validation auc = 0.589383
Epoch 72
Validation auc = 0.593155
Epoch 73
Validation auc = 0.600918
Epoch 74
Validation auc = 0.590149
Epoch 75
Loss = 5.7719e-01, PNorm = 74.1433, GNorm = 0.7660, lr_0 = 9.9828e-04
Validation auc = 0.608681
Epoch 76
Validation auc = 0.616444
Epoch 77
Validation auc = 0.650831
Epoch 78
Validation auc = 0.668216
Epoch 79
Validation auc = 0.645419
Epoch 80
Loss = 6.4144e-01, PNorm = 74.5024, GNorm = 1.0028, lr_0 = 9.9802e-04
Validation auc = 0.654931
Epoch 81
Validation auc = 0.640444
Epoch 82
Validation auc = 0.641865
Epoch 83
Validation auc = 0.647496
Epoch 84
Loss = 5.0778e-01, PNorm = 74.8178, GNorm = 0.4144, lr_0 = 9.9779e-04
Loss = 5.4634e-01, PNorm = 74.8385, GNorm = 0.7134, lr_0 = 9.9777e-04
Validation auc = 0.646075
Epoch 85
Validation auc = 0.650503
Epoch 86
Validation auc = 0.653838
Epoch 87
Validation auc = 0.659031
Epoch 88
Validation auc = 0.667888
Epoch 89
Loss = 4.4106e-01, PNorm = 75.1138, GNorm = 2.1530, lr_0 = 9.9752e-04
Loss = 1.2631e-01, PNorm = 75.1347, GNorm = 0.5724, lr_0 = 9.9750e-04
Validation auc = 0.681828
Epoch 90
Validation auc = 0.700470
Epoch 91
Validation auc = 0.706046
Epoch 92
Validation auc = 0.669965
Epoch 93
Validation auc = 0.647387
Epoch 94
Loss = 4.3087e-01, PNorm = 75.4351, GNorm = 1.1463, lr_0 = 9.9727e-04
Validation auc = 0.645528
Epoch 95
Validation auc = 0.641811
Epoch 96
Validation auc = 0.660890
Epoch 97
Validation auc = 0.662038
Epoch 98
Validation auc = 0.649191
Epoch 99
Loss = 3.3095e-01, PNorm = 75.7937, GNorm = 1.1064, lr_0 = 9.9701e-04
Validation auc = 0.631314
Epoch 100
Validation auc = 0.619943
Epoch 101
Validation auc = 0.631642
Epoch 102
Validation auc = 0.633829
Epoch 103
Loss = 2.3080e-01, PNorm = 76.0765, GNorm = 0.4984, lr_0 = 9.9678e-04
Loss = 4.4601e-01, PNorm = 76.0981, GNorm = 2.1405, lr_0 = 9.9676e-04
Validation auc = 0.635852
Epoch 104
Validation auc = 0.624426
Epoch 105
Validation auc = 0.631588
Epoch 106
Validation auc = 0.647277
Epoch 107
Validation auc = 0.582659
Epoch 108
Loss = 3.5500e-01, PNorm = 76.3979, GNorm = 3.6085, lr_0 = 9.9651e-04
Validation auc = 0.580910
Epoch 109
Validation auc = 0.630986
Epoch 110
Validation auc = 0.655150
Epoch 111
Validation auc = 0.640772
Epoch 112
Validation auc = 0.643396
Epoch 113
Loss = 3.1342e-01, PNorm = 76.7752, GNorm = 0.7257, lr_0 = 9.9627e-04
Validation auc = 0.659086
Epoch 114
Validation auc = 0.666740
Epoch 115
Validation auc = 0.663186
Epoch 116
Validation auc = 0.635360
Epoch 117
Loss = 3.8228e-01, PNorm = 77.1472, GNorm = 0.8744, lr_0 = 9.9604e-04
Loss = 2.1353e-01, PNorm = 77.1781, GNorm = 1.2093, lr_0 = 9.9602e-04
Validation auc = 0.637492
Epoch 118
Validation auc = 0.649683
Epoch 119
Validation auc = 0.647988
Epoch 120
Validation auc = 0.639679
Epoch 121
Validation auc = 0.612727
Epoch 122
Loss = 2.8630e-01, PNorm = 77.5360, GNorm = 1.6267, lr_0 = 9.9577e-04
Loss = 3.9168e-01, PNorm = 77.5589, GNorm = 8.9529, lr_0 = 9.9575e-04
Validation auc = 0.610103
Epoch 123
Validation auc = 0.616335
Epoch 124
Validation auc = 0.630002
Epoch 125
Validation auc = 0.648371
Epoch 126
Validation auc = 0.669637
Epoch 127
Loss = 2.0575e-01, PNorm = 77.9110, GNorm = 0.5655, lr_0 = 9.9552e-04
Validation auc = 0.675924
Epoch 128
Validation auc = 0.672862
Epoch 129
Validation auc = 0.667778
Epoch 130
Validation auc = 0.645747
Epoch 131
Validation auc = 0.630166
Epoch 132
Loss = 2.3227e-01, PNorm = 78.2872, GNorm = 0.6542, lr_0 = 9.9526e-04
Validation auc = 0.626230
Epoch 133
Validation auc = 0.631642
Epoch 134
Validation auc = 0.636672
Epoch 135
Validation auc = 0.651432
Epoch 136
Loss = 1.8090e-01, PNorm = 78.5814, GNorm = 0.7284, lr_0 = 9.9503e-04
Loss = 2.2403e-01, PNorm = 78.6051, GNorm = 2.7125, lr_0 = 9.9501e-04
Validation auc = 0.651924
Epoch 137
Validation auc = 0.647934
Epoch 138
Validation auc = 0.668106
Epoch 139
Validation auc = 0.669965
Epoch 140
Validation auc = 0.680407
Epoch 141
Loss = 1.3629e-01, PNorm = 78.9203, GNorm = 0.9159, lr_0 = 9.9477e-04
Validation auc = 0.690138
Epoch 142
Validation auc = 0.677947
Epoch 143
Validation auc = 0.665428
Epoch 144
Validation auc = 0.661874
Epoch 145
Validation auc = 0.659961
Epoch 146
Loss = 1.4131e-01, PNorm = 79.1929, GNorm = 1.6941, lr_0 = 9.9452e-04
Validation auc = 0.644216
Epoch 147
Validation auc = 0.638804
Epoch 148
Validation auc = 0.635250
Epoch 149
Validation auc = 0.633993
Epoch 150
Loss = 2.2417e-01, PNorm = 79.5356, GNorm = 0.6825, lr_0 = 9.9429e-04
Loss = 1.1519e+00, PNorm = 79.5506, GNorm = 13.4149, lr_0 = 9.9427e-04
Validation auc = 0.633556
Epoch 151
Validation auc = 0.644872
Epoch 152
Validation auc = 0.640881
Epoch 153
Validation auc = 0.627870
Epoch 154
Validation auc = 0.613164
Epoch 155
Loss = 1.9601e-01, PNorm = 79.8721, GNorm = 0.7512, lr_0 = 9.9403e-04
Loss = 9.8654e-02, PNorm = 79.8968, GNorm = 1.2372, lr_0 = 9.9401e-04
Validation auc = 0.604253
Epoch 156
Validation auc = 0.633282
Epoch 157
Validation auc = 0.658703
Epoch 158
Validation auc = 0.685819
Epoch 159
Validation auc = 0.682703
Epoch 160
Loss = 1.0231e-01, PNorm = 80.1979, GNorm = 1.2359, lr_0 = 9.9378e-04
Validation auc = 0.682867
Epoch 161
Validation auc = 0.671824
Epoch 162
Validation auc = 0.666193
Epoch 163
Validation auc = 0.662147
Epoch 164
Validation auc = 0.654220
Epoch 165
Loss = 1.4073e-01, PNorm = 80.5952, GNorm = 0.6459, lr_0 = 9.9351e-04
Validation auc = 0.656735
Epoch 166
Validation auc = 0.654056
Epoch 167
Validation auc = 0.644763
Epoch 168
Validation auc = 0.650175
Epoch 169
Loss = 1.9111e-01, PNorm = 80.9079, GNorm = 2.6533, lr_0 = 9.9329e-04
Loss = 3.9070e-01, PNorm = 80.9265, GNorm = 3.6169, lr_0 = 9.9327e-04
Validation auc = 0.650940
Epoch 170
Validation auc = 0.649410
Epoch 171
Validation auc = 0.657009
Epoch 172
Validation auc = 0.659141
Epoch 173
Validation auc = 0.659359
Epoch 174
Loss = 1.0015e-01, PNorm = 81.1528, GNorm = 0.5767, lr_0 = 9.9302e-04
Validation auc = 0.663131
Epoch 175
Validation auc = 0.662093
Epoch 176
Validation auc = 0.654603
Epoch 177
Validation auc = 0.623387
Epoch 178
Validation auc = 0.609829
Epoch 179
Loss = 1.4376e-01, PNorm = 81.3447, GNorm = 1.7516, lr_0 = 9.9277e-04
Validation auc = 0.616554
Epoch 180
Validation auc = 0.622239
Epoch 181
Validation auc = 0.638804
Epoch 182
Validation auc = 0.653619
Epoch 183
Loss = 1.2948e-01, PNorm = 81.5236, GNorm = 3.4462, lr_0 = 9.9253e-04
Validation auc = 0.655532
Epoch 184
Validation auc = 0.661054
Epoch 185
Validation auc = 0.660070
Epoch 186
Validation auc = 0.646075
Epoch 187
Validation auc = 0.624809
Epoch 188
Loss = 9.6476e-02, PNorm = 81.6857, GNorm = 1.8089, lr_0 = 9.9228e-04
Loss = 1.6658e-02, PNorm = 81.6955, GNorm = 0.7833, lr_0 = 9.9226e-04
Validation auc = 0.618522
Epoch 189
Validation auc = 0.625465
Epoch 190
Validation auc = 0.627597
Epoch 191
Validation auc = 0.626449
Epoch 192
Validation auc = 0.623879
Epoch 193
Loss = 1.1101e-01, PNorm = 81.8111, GNorm = 0.9292, lr_0 = 9.9204e-04
Validation auc = 0.630221
Epoch 194
Validation auc = 0.637546
Epoch 195
Validation auc = 0.640717
Epoch 196
Validation auc = 0.645583
Epoch 197
Validation auc = 0.652799
Epoch 198
Loss = 6.6714e-02, PNorm = 81.9463, GNorm = 0.4814, lr_0 = 9.9177e-04
Validation auc = 0.659797
Epoch 199
Validation auc = 0.662803
Epoch 200
Validation auc = 0.660398
Epoch 201
Validation auc = 0.658430
Epoch 202
Loss = 5.5006e-02, PNorm = 82.0498, GNorm = 1.0546, lr_0 = 9.9154e-04
Loss = 2.5935e-02, PNorm = 82.0579, GNorm = 0.3328, lr_0 = 9.9153e-04
Validation auc = 0.658485
Epoch 203
Validation auc = 0.663459
Epoch 204
Validation auc = 0.671933
Epoch 205
Validation auc = 0.677072
Epoch 206
Validation auc = 0.675213
Epoch 207
Loss = 1.2485e-01, PNorm = 82.1736, GNorm = 1.7311, lr_0 = 9.9128e-04
Loss = 7.8799e-03, PNorm = 82.1816, GNorm = 0.1214, lr_0 = 9.9126e-04
Validation auc = 0.670840
Epoch 208
Validation auc = 0.667122
Epoch 209
Validation auc = 0.660781
Epoch 210
Validation auc = 0.676853
Epoch 211
Validation auc = 0.691559
Epoch 212
Loss = 9.8075e-03, PNorm = 82.2531, GNorm = 0.2935, lr_0 = 9.9103e-04
Validation auc = 0.701181
Epoch 213
Validation auc = 0.706593
Epoch 214
Validation auc = 0.715121
Epoch 215
Validation auc = 0.719604
Epoch 216
Loss = 2.4497e-01, PNorm = 82.2994, GNorm = 4.2727, lr_0 = 9.9079e-04
Validation auc = 0.715176
Epoch 217
Validation auc = 0.715067
Epoch 218
Validation auc = 0.706265
Epoch 219
Validation auc = 0.692817
Epoch 220
Validation auc = 0.681281
Epoch 221
Loss = 1.0267e-01, PNorm = 82.4125, GNorm = 1.1196, lr_0 = 9.9054e-04
Loss = 3.0363e-02, PNorm = 82.4244, GNorm = 0.4054, lr_0 = 9.9052e-04
Validation auc = 0.666084
Epoch 222
Validation auc = 0.656899
Epoch 223
Validation auc = 0.645419
Epoch 224
Validation auc = 0.636672
Epoch 225
Validation auc = 0.626175
Epoch 226
Loss = 1.6163e-01, PNorm = 82.5663, GNorm = 1.0825, lr_0 = 9.9030e-04
Validation auc = 0.621310
Epoch 227
Validation auc = 0.618194
Epoch 228
Validation auc = 0.618412
Epoch 229
Validation auc = 0.644708
Epoch 230
Validation auc = 0.662858
Epoch 231
Loss = 4.1652e-02, PNorm = 82.6706, GNorm = 2.5064, lr_0 = 9.9003e-04
Validation auc = 0.684398
Epoch 232
Validation auc = 0.693691
Epoch 233
Validation auc = 0.701564
Epoch 234
Validation auc = 0.701837
Epoch 235
Loss = 2.3207e-02, PNorm = 82.7983, GNorm = 1.2006, lr_0 = 9.8980e-04
Loss = 2.5175e-03, PNorm = 82.8087, GNorm = 0.0568, lr_0 = 9.8979e-04
Validation auc = 0.700306
Epoch 236
Validation auc = 0.700306
Epoch 237
Validation auc = 0.695277
Epoch 238
Validation auc = 0.689154
Epoch 239
Validation auc = 0.684343
Epoch 240
Loss = 1.4011e-02, PNorm = 82.9256, GNorm = 0.6850, lr_0 = 9.8954e-04
Loss = 4.4278e-01, PNorm = 82.9324, GNorm = 9.6870, lr_0 = 9.8952e-04
Validation auc = 0.686475
Epoch 241
Validation auc = 0.690302
Epoch 242
Validation auc = 0.691067
Epoch 243
Validation auc = 0.695331
Epoch 244
Validation auc = 0.694511
Epoch 245
Loss = 1.5139e-01, PNorm = 83.0731, GNorm = 1.4601, lr_0 = 9.8930e-04
Validation auc = 0.694293
Epoch 246
Validation auc = 0.688552
Epoch 247
Validation auc = 0.698721
Epoch 248
Validation auc = 0.696971
Epoch 249
Loss = 4.2607e-02, PNorm = 83.2056, GNorm = 2.6635, lr_0 = 9.8905e-04
Validation auc = 0.694949
Epoch 250
Validation auc = 0.692543
Epoch 251
Validation auc = 0.695933
Epoch 252
Validation auc = 0.709326
Epoch 253
Validation auc = 0.713645
Epoch 254
Loss = 1.5040e-01, PNorm = 83.4293, GNorm = 1.8955, lr_0 = 9.8880e-04
Loss = 7.6979e-01, PNorm = 83.4487, GNorm = 4.6737, lr_0 = 9.8879e-04
Validation auc = 0.715285
Epoch 255
Validation auc = 0.685928
Epoch 256
Validation auc = 0.655587
Epoch 257
Validation auc = 0.640225
Epoch 258
Validation auc = 0.631260
Epoch 259
Loss = 1.7614e-01, PNorm = 83.7107, GNorm = 0.8312, lr_0 = 9.8856e-04
Validation auc = 0.623989
Epoch 260
Validation auc = 0.616226
Epoch 261
Validation auc = 0.609884
Epoch 262
Validation auc = 0.606276
Epoch 263
Validation auc = 0.604636
Epoch 264
Loss = 7.8265e-02, PNorm = 83.9205, GNorm = 1.0501, lr_0 = 9.8830e-04
Validation auc = 0.604199
Epoch 265
Validation auc = 0.610540
Epoch 266
Validation auc = 0.612618
Epoch 267
Validation auc = 0.617374
Epoch 268
Loss = 2.9857e-02, PNorm = 84.0228, GNorm = 0.0902, lr_0 = 9.8807e-04
Loss = 6.3995e-03, PNorm = 84.0297, GNorm = 0.0995, lr_0 = 9.8805e-04
Validation auc = 0.621474
Epoch 269
Validation auc = 0.626121
Epoch 270
Validation auc = 0.632244
Epoch 271
Validation auc = 0.637273
Epoch 272
Validation auc = 0.643888
Epoch 273
Loss = 4.0177e-02, PNorm = 84.1272, GNorm = 1.2267, lr_0 = 9.8781e-04
Loss = 1.0669e-02, PNorm = 84.1342, GNorm = 0.5118, lr_0 = 9.8779e-04
Validation auc = 0.658539
Epoch 274
Validation auc = 0.662639
Epoch 275
Validation auc = 0.668653
Epoch 276
Validation auc = 0.674995
Epoch 277
Validation auc = 0.677728
Epoch 278
Loss = 4.3782e-03, PNorm = 84.2300, GNorm = 0.0935, lr_0 = 9.8756e-04
Validation auc = 0.682757
Epoch 279
Validation auc = 0.691887
Epoch 280
Validation auc = 0.683414
Epoch 281
Validation auc = 0.669254
Epoch 282
Validation auc = 0.668106
Epoch 283
Loss = 6.6287e-01, PNorm = 84.4626, GNorm = 8.1994, lr_0 = 9.8730e-04
Validation auc = 0.652854
Epoch 284
Validation auc = 0.622021
Epoch 285
Validation auc = 0.622294
Epoch 286
Validation auc = 0.644380
Epoch 287
Loss = 1.3518e-01, PNorm = 84.7663, GNorm = 0.9978, lr_0 = 9.8707e-04
Loss = 4.1402e-02, PNorm = 84.7865, GNorm = 0.7344, lr_0 = 9.8705e-04
Validation auc = 0.657009
Epoch 288
Validation auc = 0.664170
Epoch 289
Validation auc = 0.660999
Epoch 290
Validation auc = 0.657993
Epoch 291
Validation auc = 0.647551
Epoch 292
Loss = 1.6489e-01, PNorm = 85.0305, GNorm = 1.4589, lr_0 = 9.8683e-04
Validation auc = 0.638585
Epoch 293
Validation auc = 0.621419
Epoch 294
Validation auc = 0.631478
Epoch 295
Validation auc = 0.635742
Epoch 296
Validation auc = 0.640663
Epoch 297
Loss = 4.5689e-02, PNorm = 85.2249, GNorm = 1.0877, lr_0 = 9.8656e-04
Validation auc = 0.643123
Epoch 298
Validation auc = 0.648262
Epoch 299
Validation auc = 0.662612
Epoch 300
Validation auc = 0.670402
Epoch 301
Loss = 2.1074e-02, PNorm = 85.3632, GNorm = 0.2054, lr_0 = 9.8634e-04
Loss = 1.5467e-03, PNorm = 85.3814, GNorm = 0.0321, lr_0 = 9.8632e-04
Validation auc = 0.667614
Epoch 302
Validation auc = 0.664881
Epoch 303
Validation auc = 0.671277
Epoch 304
Validation auc = 0.681555
Epoch 305
Validation auc = 0.687240
Epoch 306
Loss = 6.8223e-02, PNorm = 85.6173, GNorm = 0.8206, lr_0 = 9.8607e-04
Loss = 2.1183e-02, PNorm = 85.6324, GNorm = 0.4430, lr_0 = 9.8606e-04
Validation auc = 0.688115
Epoch 307
Validation auc = 0.683960
Epoch 308
Validation auc = 0.685108
Epoch 309
Validation auc = 0.686366
Epoch 310
Validation auc = 0.687350
Epoch 311
Loss = 5.7922e-02, PNorm = 85.7956, GNorm = 1.1709, lr_0 = 9.8583e-04
Validation auc = 0.685655
Epoch 312
Validation auc = 0.685026
Epoch 313
Validation auc = 0.683195
Epoch 314
Validation auc = 0.682703
Epoch 315
Validation auc = 0.682921
Epoch 316
Loss = 2.5799e-03, PNorm = 85.9013, GNorm = 0.0386, lr_0 = 9.8557e-04
Validation auc = 0.683796
Epoch 317
Validation auc = 0.684452
Epoch 318
Validation auc = 0.684726
Epoch 319
Validation auc = 0.684234
Epoch 320
Loss = 5.9055e-02, PNorm = 85.9407, GNorm = 1.1982, lr_0 = 9.8534e-04
Loss = 1.0206e-03, PNorm = 85.9429, GNorm = 0.0244, lr_0 = 9.8532e-04
Validation auc = 0.681992
Epoch 321
Validation auc = 0.679423
Epoch 322
Validation auc = 0.677837
Epoch 323
Validation auc = 0.677892
Epoch 324
Validation auc = 0.674940
Epoch 325
Loss = 8.5395e-03, PNorm = 85.9626, GNorm = 0.1857, lr_0 = 9.8509e-04
Validation auc = 0.671332
Epoch 326
Validation auc = 0.666794
Epoch 327
Validation auc = 0.663678
Epoch 328
Validation auc = 0.659359
Epoch 329
Validation auc = 0.655642
Epoch 330
Loss = 3.1036e-03, PNorm = 86.0068, GNorm = 0.0630, lr_0 = 9.8483e-04
Validation auc = 0.656735
Epoch 331
Validation auc = 0.673190
Epoch 332
Validation auc = 0.702985
Epoch 333
Validation auc = 0.714411
Epoch 334
Loss = 1.0810e-01, PNorm = 86.1702, GNorm = 1.5549, lr_0 = 9.8461e-04
Loss = 1.4234e-02, PNorm = 86.1892, GNorm = 0.5780, lr_0 = 9.8459e-04
Validation auc = 0.712005
Epoch 335
Validation auc = 0.707577
Epoch 336
Validation auc = 0.710311
Epoch 337
Validation auc = 0.707522
Epoch 338
Validation auc = 0.693363
Epoch 339
Loss = 5.2199e-02, PNorm = 86.4420, GNorm = 0.5875, lr_0 = 9.8434e-04
Loss = 4.7570e-02, PNorm = 86.4606, GNorm = 0.8002, lr_0 = 9.8433e-04
Validation auc = 0.681445
Epoch 340
Validation auc = 0.674940
Epoch 341
Validation auc = 0.666630
Epoch 342
Validation auc = 0.661109
Epoch 343
Validation auc = 0.656954
Epoch 344
Loss = 9.2824e-02, PNorm = 86.6797, GNorm = 1.2364, lr_0 = 9.8410e-04
Validation auc = 0.642139
Epoch 345
Validation auc = 0.663951
Epoch 346
Validation auc = 0.680571
Epoch 347
Validation auc = 0.691122
Epoch 348
Validation auc = 0.696862
Epoch 349
Loss = 1.3906e-01, PNorm = 86.8219, GNorm = 0.6597, lr_0 = 9.8384e-04
Validation auc = 0.696315
Epoch 350
Validation auc = 0.696425
Epoch 351
Validation auc = 0.695933
Epoch 352
Validation auc = 0.691832
Epoch 353
Loss = 4.9181e-03, PNorm = 86.9106, GNorm = 0.0570, lr_0 = 9.8361e-04
Loss = 2.0320e-03, PNorm = 86.9183, GNorm = 0.0410, lr_0 = 9.8359e-04
Validation auc = 0.688060
Epoch 354
Validation auc = 0.685436
Epoch 355
Validation auc = 0.683140
Epoch 356
Validation auc = 0.681281
Epoch 357
Validation auc = 0.681937
Epoch 358
Loss = 7.6359e-02, PNorm = 86.9964, GNorm = 2.1530, lr_0 = 9.8335e-04
Validation auc = 0.677181
Epoch 359
Validation auc = 0.650284
Epoch 360
Validation auc = 0.641756
Epoch 361
Validation auc = 0.623606
Epoch 362
Validation auc = 0.611469
Epoch 363
Loss = 2.0456e-01, PNorm = 87.1543, GNorm = 1.4558, lr_0 = 9.8311e-04
Validation auc = 0.610267
Epoch 364
Validation auc = 0.615952
Epoch 365
Validation auc = 0.639515
Epoch 366
Validation auc = 0.657938
Epoch 367
Loss = 1.5191e-01, PNorm = 87.4300, GNorm = 0.7458, lr_0 = 9.8288e-04
Loss = 1.0983e-01, PNorm = 87.4519, GNorm = 1.8459, lr_0 = 9.8286e-04
Validation auc = 0.659086
Epoch 368
Validation auc = 0.650066
Epoch 369
Validation auc = 0.642084
Epoch 370
Validation auc = 0.653455
Epoch 371
Validation auc = 0.660999
Epoch 372
Loss = 8.6169e-02, PNorm = 87.7274, GNorm = 0.6699, lr_0 = 9.8262e-04
Loss = 5.9719e-02, PNorm = 87.7448, GNorm = 1.2708, lr_0 = 9.8260e-04
Validation auc = 0.665592
Epoch 373
Validation auc = 0.668653
Epoch 374
Validation auc = 0.669418
Epoch 375
Validation auc = 0.669200
Epoch 376
Validation auc = 0.668489
Epoch 377
Loss = 1.4924e-02, PNorm = 87.9451, GNorm = 0.2340, lr_0 = 9.8237e-04
Validation auc = 0.672917
Epoch 378
Validation auc = 0.672917
Epoch 379
Validation auc = 0.673026
Epoch 380
Validation auc = 0.672370
Epoch 381
Validation auc = 0.675924
Epoch 382
Loss = 8.8339e-02, PNorm = 88.1446, GNorm = 1.9152, lr_0 = 9.8211e-04
Validation auc = 0.672480
Epoch 383
Validation auc = 0.684780
Epoch 384
Validation auc = 0.686639
Epoch 385
Validation auc = 0.687459
Epoch 386
Loss = 3.6831e-02, PNorm = 88.2810, GNorm = 0.7666, lr_0 = 9.8189e-04
Loss = 1.0058e-02, PNorm = 88.2901, GNorm = 0.1725, lr_0 = 9.8187e-04
Validation auc = 0.686202
Epoch 387
Validation auc = 0.670457
Epoch 388
Validation auc = 0.689099
Epoch 389
Validation auc = 0.706538
Epoch 390
Validation auc = 0.706101
Epoch 391
Loss = 3.7714e-02, PNorm = 88.3613, GNorm = 0.2703, lr_0 = 9.8163e-04
Validation auc = 0.702766
Epoch 392
Validation auc = 0.701837
Epoch 393
Validation auc = 0.702110
Epoch 394
Validation auc = 0.701892
Epoch 395
Validation auc = 0.701509
Epoch 396
Loss = 4.5178e-02, PNorm = 88.5526, GNorm = 0.7620, lr_0 = 9.8138e-04
Validation auc = 0.699541
Epoch 397
Validation auc = 0.695714
Epoch 398
Validation auc = 0.695878
Epoch 399
Validation auc = 0.697463
Epoch 400
Loss = 1.3203e-01, PNorm = 88.7038, GNorm = 1.4479, lr_0 = 9.8116e-04
Loss = 7.8057e-01, PNorm = 88.7124, GNorm = 5.7954, lr_0 = 9.8114e-04
Validation auc = 0.690466
Epoch 401
Validation auc = 0.695823
Epoch 402
Validation auc = 0.714247
Epoch 403
Validation auc = 0.723158
Epoch 404
Validation auc = 0.718019
Epoch 405
Loss = 7.0084e-02, PNorm = 88.8434, GNorm = 0.5463, lr_0 = 9.8089e-04
Loss = 1.3036e-01, PNorm = 88.8551, GNorm = 3.3439, lr_0 = 9.8088e-04
Validation auc = 0.717089
Epoch 406
Validation auc = 0.716597
Epoch 407
Validation auc = 0.716761
Epoch 408
Validation auc = 0.716816
Epoch 409
Validation auc = 0.716051
Epoch 410
Loss = 1.7808e-02, PNorm = 89.0145, GNorm = 0.1695, lr_0 = 9.8065e-04
Validation auc = 0.713809
Epoch 411
Validation auc = 0.709217
Epoch 412
Validation auc = 0.705882
Epoch 413
Validation auc = 0.705172
Epoch 414
Validation auc = 0.702438
Epoch 415
Loss = 5.1105e-03, PNorm = 89.1760, GNorm = 0.0508, lr_0 = 9.8039e-04
Validation auc = 0.702056
Epoch 416
Validation auc = 0.701181
Epoch 417
Validation auc = 0.699650
Epoch 418
Validation auc = 0.698229
Epoch 419
Loss = 5.9841e-02, PNorm = 89.2586, GNorm = 1.2156, lr_0 = 9.8016e-04
Loss = 3.5316e-03, PNorm = 89.2621, GNorm = 0.0893, lr_0 = 9.8015e-04
Validation auc = 0.698393
Epoch 420
Validation auc = 0.699869
Epoch 421
Validation auc = 0.699486
Epoch 422
Validation auc = 0.697245
Epoch 423
Validation auc = 0.696698
Epoch 424
Loss = 4.0732e-03, PNorm = 89.3141, GNorm = 0.0478, lr_0 = 9.7990e-04
Validation auc = 0.695659
Epoch 425
Validation auc = 0.696643
Epoch 426
Validation auc = 0.699705
Epoch 427
Validation auc = 0.701345
Epoch 428
Validation auc = 0.702766
Epoch 429
Loss = 1.6344e-02, PNorm = 89.3787, GNorm = 0.3344, lr_0 = 9.7966e-04
Validation auc = 0.705336
Epoch 430
Validation auc = 0.705172
Epoch 431
Validation auc = 0.704461
Epoch 432
Validation auc = 0.710092
Epoch 433
Loss = 1.3690e-01, PNorm = 89.4846, GNorm = 20.0009, lr_0 = 9.7942e-04
Validation auc = 0.729609
Epoch 434
Validation auc = 0.761535
Epoch 435
Validation auc = 0.764870
Epoch 436
Validation auc = 0.754756
Epoch 437
Validation auc = 0.736387
Epoch 438
Loss = 7.8973e-02, PNorm = 89.7860, GNorm = 0.5041, lr_0 = 9.7917e-04
Loss = 1.1567e-02, PNorm = 89.8102, GNorm = 0.1644, lr_0 = 9.7916e-04
Validation auc = 0.719167
Epoch 439
Validation auc = 0.704625
Epoch 440
Validation auc = 0.696479
Epoch 441
Validation auc = 0.691450
Epoch 442
Validation auc = 0.691997
Epoch 443
Loss = 3.7884e-02, PNorm = 90.0322, GNorm = 0.8974, lr_0 = 9.7893e-04
Validation auc = 0.687022
Epoch 444
Validation auc = 0.684343
Epoch 445
Validation auc = 0.683250
Epoch 446
Validation auc = 0.682375
Epoch 447
Validation auc = 0.681883
Epoch 448
Loss = 4.7088e-02, PNorm = 90.1712, GNorm = 0.7415, lr_0 = 9.7867e-04
Validation auc = 0.679915
Epoch 449
Validation auc = 0.678001
Epoch 450
Validation auc = 0.676033
Epoch 451
Validation auc = 0.675049
Epoch 452
Loss = 5.4462e-03, PNorm = 90.2307, GNorm = 0.1098, lr_0 = 9.7845e-04
Loss = 3.2498e-03, PNorm = 90.2349, GNorm = 0.1266, lr_0 = 9.7843e-04
Validation auc = 0.675760
Epoch 453
Validation auc = 0.675596
Epoch 454
Validation auc = 0.675049
Epoch 455
Validation auc = 0.675268
Epoch 456
Validation auc = 0.674831
Epoch 457
Loss = 1.2945e-03, PNorm = 90.2874, GNorm = 0.0201, lr_0 = 9.7819e-04
Loss = 4.9493e-04, PNorm = 90.2903, GNorm = 0.0130, lr_0 = 9.7817e-04
Validation auc = 0.673628
Epoch 458
Validation auc = 0.674995
Epoch 459
Validation auc = 0.674831
Epoch 460
Validation auc = 0.677619
Epoch 461
Validation auc = 0.677072
Epoch 462
Loss = 4.7383e-02, PNorm = 90.3478, GNorm = 1.3558, lr_0 = 9.7794e-04
Validation auc = 0.675432
Epoch 463
Validation auc = 0.674010
Epoch 464
Validation auc = 0.673846
Epoch 465
Validation auc = 0.673300
Epoch 466
Loss = 7.5524e-02, PNorm = 90.4031, GNorm = 0.2227, lr_0 = 9.7770e-04
Validation auc = 0.678931
Epoch 467
Validation auc = 0.687131
Epoch 468
Validation auc = 0.691504
Epoch 469
Validation auc = 0.693145
Epoch 470
Validation auc = 0.691450
Epoch 471
Loss = 9.1268e-03, PNorm = 90.4787, GNorm = 0.5329, lr_0 = 9.7746e-04
Loss = 2.1786e-03, PNorm = 90.4844, GNorm = 0.0456, lr_0 = 9.7744e-04
Validation auc = 0.691668
Epoch 472
Validation auc = 0.691450
Epoch 473
Validation auc = 0.690794
Epoch 474
Validation auc = 0.689864
Epoch 475
Validation auc = 0.690138
Epoch 476
Loss = 1.2074e-02, PNorm = 90.5391, GNorm = 0.5558, lr_0 = 9.7721e-04
Validation auc = 0.691559
Epoch 477
Validation auc = 0.691286
Epoch 478
Validation auc = 0.690739
Epoch 479
Validation auc = 0.690247
Epoch 480
Validation auc = 0.687295
Epoch 481
Loss = 3.3246e-03, PNorm = 90.5947, GNorm = 0.0697, lr_0 = 9.7695e-04
Validation auc = 0.684288
Epoch 482
Validation auc = 0.686858
Epoch 483
Validation auc = 0.690028
Epoch 484
Validation auc = 0.690356
Epoch 485
Loss = 5.5811e-03, PNorm = 90.6368, GNorm = 0.1244, lr_0 = 9.7673e-04
Loss = 4.5661e-04, PNorm = 90.6400, GNorm = 0.0119, lr_0 = 9.7671e-04
Validation auc = 0.689755
Epoch 486
Validation auc = 0.690138
Epoch 487
Validation auc = 0.690411
Epoch 488
Validation auc = 0.694457
Epoch 489
Validation auc = 0.698065
Epoch 490
Loss = 6.5732e-03, PNorm = 90.6876, GNorm = 0.2557, lr_0 = 9.7647e-04
Loss = 6.3115e-04, PNorm = 90.6911, GNorm = 0.0225, lr_0 = 9.7645e-04
Validation auc = 0.700689
Epoch 491
Validation auc = 0.701126
Epoch 492
Validation auc = 0.700743
Epoch 493
Validation auc = 0.703094
Epoch 494
Validation auc = 0.706757
Epoch 495
Loss = 2.5018e-03, PNorm = 90.7350, GNorm = 0.0725, lr_0 = 9.7623e-04
Validation auc = 0.707577
Epoch 496
Validation auc = 0.698939
Epoch 497
Validation auc = 0.687240
Epoch 498
Validation auc = 0.677455
Epoch 499
Loss = 2.2801e-02, PNorm = 90.8385, GNorm = 0.0366, lr_0 = 9.7599e-04
Validation auc = 0.674940
Epoch 500
Validation auc = 0.673682
Epoch 501
Validation auc = 0.675760
Epoch 502
Validation auc = 0.683304
Epoch 503
Validation auc = 0.688443
Epoch 504
Loss = 1.5948e-02, PNorm = 90.9183, GNorm = 0.0683, lr_0 = 9.7574e-04
Loss = 7.1677e-03, PNorm = 90.9231, GNorm = 0.2156, lr_0 = 9.7573e-04
Validation auc = 0.692871
Epoch 505
Validation auc = 0.696042
Epoch 506
Validation auc = 0.693965
Epoch 507
Validation auc = 0.691887
Epoch 508
Validation auc = 0.691176
Epoch 509
Loss = 6.2141e-03, PNorm = 90.9769, GNorm = 0.2178, lr_0 = 9.7550e-04
Validation auc = 0.692270
Epoch 510
Validation auc = 0.695878
Epoch 511
Validation auc = 0.698611
Epoch 512
Validation auc = 0.705992
Epoch 513
Validation auc = 0.709272
Epoch 514
Loss = 7.8517e-02, PNorm = 91.0134, GNorm = 0.5555, lr_0 = 9.7524e-04
Validation auc = 0.708889
Epoch 515
Validation auc = 0.709545
Epoch 516
Validation auc = 0.711513
Epoch 517
Validation auc = 0.710311
Epoch 518
Loss = 2.1444e-02, PNorm = 91.0625, GNorm = 0.1589, lr_0 = 9.7502e-04
Loss = 3.9478e-02, PNorm = 91.0680, GNorm = 0.9663, lr_0 = 9.7500e-04
Validation auc = 0.709272
Epoch 519
Validation auc = 0.706265
Epoch 520
Validation auc = 0.702766
Epoch 521
Validation auc = 0.698611
Epoch 522
Validation auc = 0.694293
Epoch 523
Loss = 2.4110e-02, PNorm = 91.1434, GNorm = 0.2476, lr_0 = 9.7476e-04
Loss = 4.5611e-03, PNorm = 91.1485, GNorm = 0.1706, lr_0 = 9.7474e-04
Validation auc = 0.693855
Epoch 524
Validation auc = 0.692106
Epoch 525
Validation auc = 0.686420
Epoch 526
Validation auc = 0.680407
Epoch 527
Validation auc = 0.677127
Epoch 528
Loss = 2.0918e-03, PNorm = 91.2189, GNorm = 0.0496, lr_0 = 9.7452e-04
Validation auc = 0.676744
Epoch 529
Validation auc = 0.675487
Epoch 530
Validation auc = 0.674995
Epoch 531
Validation auc = 0.674010
Epoch 532
Validation auc = 0.672589
Epoch 533
Loss = 2.0265e-03, PNorm = 91.2865, GNorm = 0.0572, lr_0 = 9.7426e-04
Validation auc = 0.673190
Epoch 534
Validation auc = 0.671441
Epoch 535
Validation auc = 0.672753
Epoch 536
Validation auc = 0.673136
Epoch 537
Loss = 5.8028e-03, PNorm = 91.3150, GNorm = 0.3595, lr_0 = 9.7403e-04
Loss = 6.3830e-04, PNorm = 91.3172, GNorm = 0.0189, lr_0 = 9.7401e-04
Validation auc = 0.673792
Epoch 538
Validation auc = 0.674229
Epoch 539
Validation auc = 0.679204
Epoch 540
Validation auc = 0.685054
Epoch 541
Validation auc = 0.690138
Epoch 542
Loss = 5.0345e-03, PNorm = 91.3949, GNorm = 0.1867, lr_0 = 9.7379e-04
Validation auc = 0.693746
Epoch 543
Validation auc = 0.695933
Epoch 544
Validation auc = 0.700306
Epoch 545
Validation auc = 0.698447
Epoch 546
Validation auc = 0.695331
Epoch 547
Loss = 5.1037e-03, PNorm = 91.4944, GNorm = 0.1369, lr_0 = 9.7353e-04
Validation auc = 0.693145
Epoch 548
Validation auc = 0.689482
Epoch 549
Validation auc = 0.687404
Epoch 550
Validation auc = 0.685054
Epoch 551
Loss = 1.4240e-02, PNorm = 91.5593, GNorm = 0.0475, lr_0 = 9.7331e-04
Loss = 9.4029e-03, PNorm = 91.5638, GNorm = 0.7130, lr_0 = 9.7329e-04
Validation auc = 0.681664
Epoch 552
Validation auc = 0.678712
Epoch 553
Validation auc = 0.676635
Epoch 554
Validation auc = 0.675213
Epoch 555
Validation auc = 0.674065
Epoch 556
Loss = 1.5916e-03, PNorm = 91.6136, GNorm = 0.0047, lr_0 = 9.7305e-04
Loss = 5.4138e-05, PNorm = 91.6163, GNorm = 0.0017, lr_0 = 9.7303e-04
Validation auc = 0.673846
Epoch 557
Validation auc = 0.673846
Epoch 558
Validation auc = 0.673136
Epoch 559
Validation auc = 0.671660
Epoch 560
Validation auc = 0.671277
Epoch 561
Loss = 1.3340e-03, PNorm = 91.6652, GNorm = 0.0178, lr_0 = 9.7281e-04
Validation auc = 0.669582
Epoch 562
Validation auc = 0.668270
Epoch 563
Validation auc = 0.665099
Epoch 564
Validation auc = 0.660890
Epoch 565
Validation auc = 0.660999
Epoch 566
Loss = 1.5628e-03, PNorm = 91.7131, GNorm = 0.0449, lr_0 = 9.7255e-04
Validation auc = 0.657993
Epoch 567
Validation auc = 0.654876
Epoch 568
Validation auc = 0.658102
Epoch 569
Validation auc = 0.660617
Epoch 570
Loss = 7.9289e-04, PNorm = 91.7505, GNorm = 0.0103, lr_0 = 9.7232e-04
Loss = 4.7970e-04, PNorm = 91.7541, GNorm = 0.0150, lr_0 = 9.7231e-04
Validation auc = 0.662038
Epoch 571
Validation auc = 0.663842
Epoch 572
Validation auc = 0.665428
Epoch 573
Validation auc = 0.667013
Epoch 574
Validation auc = 0.667177
Epoch 575
Loss = 8.7501e-04, PNorm = 91.8000, GNorm = 0.0234, lr_0 = 9.7208e-04
Validation auc = 0.667778
Epoch 576
Validation auc = 0.672425
Epoch 577
Validation auc = 0.673983
Epoch 578
Validation auc = 0.675213
Epoch 579
Validation auc = 0.675514
Epoch 580
Loss = 1.5634e-03, PNorm = 91.8479, GNorm = 0.0349, lr_0 = 9.7182e-04
Validation auc = 0.675213
Epoch 581
Validation auc = 0.673518
Epoch 582
Validation auc = 0.676088
Epoch 583
Validation auc = 0.676717
Epoch 584
Loss = 1.8749e-02, PNorm = 91.8790, GNorm = 0.0223, lr_0 = 9.7160e-04
Loss = 1.3299e-04, PNorm = 91.8809, GNorm = 0.0054, lr_0 = 9.7158e-04
Validation auc = 0.669364
Epoch 585
Validation auc = 0.666466
Epoch 586
Validation auc = 0.663951
Epoch 587
Validation auc = 0.664498
Epoch 588
Validation auc = 0.666302
Epoch 589
Loss = 7.1013e-02, PNorm = 91.9210, GNorm = 0.7105, lr_0 = 9.7134e-04
Loss = 6.7024e-04, PNorm = 91.9228, GNorm = 0.0247, lr_0 = 9.7132e-04
Validation auc = 0.669309
Epoch 590
Validation auc = 0.669364
Epoch 591
Validation auc = 0.669309
Epoch 592
Validation auc = 0.674010
Epoch 593
Validation auc = 0.683414
Epoch 594
Loss = 5.1643e-03, PNorm = 91.9737, GNorm = 0.2260, lr_0 = 9.7110e-04
Validation auc = 0.690794
Epoch 595
Validation auc = 0.697901
Epoch 596
Validation auc = 0.699814
Epoch 597
Validation auc = 0.700525
Epoch 598
Validation auc = 0.698557
Epoch 599
Loss = 2.9549e-03, PNorm = 92.0971, GNorm = 0.0744, lr_0 = 9.7084e-04
Validation auc = 0.696370
Epoch 600
Validation auc = 0.692598
Epoch 601
Validation auc = 0.686256
Epoch 602
Validation auc = 0.680735
Epoch 603
Loss = 2.2402e-02, PNorm = 92.1797, GNorm = 1.1220, lr_0 = 9.7062e-04
Loss = 3.1909e-03, PNorm = 92.1853, GNorm = 0.0777, lr_0 = 9.7060e-04
Validation auc = 0.674339
Epoch 604
Validation auc = 0.671168
Epoch 605
Validation auc = 0.651378
Epoch 606
Validation auc = 0.669910
Epoch 607
Validation auc = 0.675541
Epoch 608
Loss = 3.0608e-03, PNorm = 92.2580, GNorm = 0.0435, lr_0 = 9.7036e-04
Validation auc = 0.678056
Epoch 609
Validation auc = 0.676252
Epoch 610
Validation auc = 0.665318
Epoch 611
Validation auc = 0.679641
Epoch 612
Validation auc = 0.698283
Epoch 613
Loss = 6.9515e-02, PNorm = 92.3231, GNorm = 0.6205, lr_0 = 9.7012e-04
Validation auc = 0.704406
Epoch 614
Validation auc = 0.703532
Epoch 615
Validation auc = 0.692161
Epoch 616
Validation auc = 0.663678
Epoch 617
Loss = 1.2117e-01, PNorm = 92.4711, GNorm = 0.7156, lr_0 = 9.6990e-04
Loss = 2.6606e-02, PNorm = 92.4900, GNorm = 0.5998, lr_0 = 9.6988e-04
Validation auc = 0.655751
Epoch 618
Validation auc = 0.653564
Epoch 619
Validation auc = 0.653291
Epoch 620
Validation auc = 0.648262
Epoch 621
Validation auc = 0.619287
Epoch 622
Loss = 1.5556e-01, PNorm = 92.7833, GNorm = 1.5944, lr_0 = 9.6964e-04
Loss = 1.8508e-01, PNorm = 92.8073, GNorm = 16.9523, lr_0 = 9.6962e-04
Validation auc = 0.615788
Epoch 623
Validation auc = 0.618850
Epoch 624
Validation auc = 0.649738
Epoch 625
Validation auc = 0.681555
Epoch 626
Validation auc = 0.698119
Epoch 627
Loss = 4.8863e-02, PNorm = 93.1704, GNorm = 0.6725, lr_0 = 9.6940e-04
Validation auc = 0.714028
Epoch 628
Validation auc = 0.722447
Epoch 629
Validation auc = 0.727039
Epoch 630
Validation auc = 0.735786
Epoch 631
Validation auc = 0.737645
Epoch 632
Loss = 1.3469e-02, PNorm = 93.4752, GNorm = 0.2517, lr_0 = 9.6914e-04
Validation auc = 0.737536
Epoch 633
Validation auc = 0.738356
Epoch 634
Validation auc = 0.737262
Epoch 635
Validation auc = 0.734857
Epoch 636
Loss = 7.2751e-03, PNorm = 93.6413, GNorm = 0.0804, lr_0 = 9.6892e-04
Loss = 1.6242e-03, PNorm = 93.6514, GNorm = 0.0343, lr_0 = 9.6890e-04
Validation auc = 0.733599
Epoch 637
Validation auc = 0.732178
Epoch 638
Validation auc = 0.724415
Epoch 639
Validation auc = 0.714247
Epoch 640
Validation auc = 0.706757
Epoch 641
Loss = 6.8367e-02, PNorm = 93.7910, GNorm = 0.4395, lr_0 = 9.6866e-04
Validation auc = 0.702821
Epoch 642
Validation auc = 0.700743
Epoch 643
Validation auc = 0.697463
Epoch 644
Validation auc = 0.698119
Epoch 645
Validation auc = 0.698611
Epoch 646
Loss = 9.0470e-02, PNorm = 93.9019, GNorm = 1.8371, lr_0 = 9.6842e-04
Validation auc = 0.702657
Epoch 647
Validation auc = 0.707358
Epoch 648
Validation auc = 0.708506
Epoch 649
Validation auc = 0.707522
Epoch 650
Loss = 2.5197e-02, PNorm = 94.0274, GNorm = 0.0224, lr_0 = 9.6820e-04
Loss = 2.9581e-01, PNorm = 94.0393, GNorm = 13.0329, lr_0 = 9.6818e-04
Validation auc = 0.713973
Epoch 651
Validation auc = 0.726984
Epoch 652
Validation auc = 0.734310
Epoch 653
Validation auc = 0.746939
Epoch 654
Validation auc = 0.751257
Epoch 655
Loss = 1.5684e-01, PNorm = 94.3365, GNorm = 4.1402, lr_0 = 9.6794e-04
Loss = 2.8633e-03, PNorm = 94.3552, GNorm = 0.0656, lr_0 = 9.6792e-04
Validation auc = 0.759020
Epoch 656
Validation auc = 0.764870
Epoch 657
Validation auc = 0.759294
Epoch 658
Validation auc = 0.753335
Epoch 659
Validation auc = 0.748633
Epoch 660
Loss = 1.1966e-02, PNorm = 94.5588, GNorm = 0.1588, lr_0 = 9.6770e-04
Validation auc = 0.745736
Epoch 661
Validation auc = 0.742620
Epoch 662
Validation auc = 0.740816
Epoch 663
Validation auc = 0.738793
Epoch 664
Validation auc = 0.736825
Epoch 665
Loss = 3.5376e-03, PNorm = 94.6779, GNorm = 0.0867, lr_0 = 9.6744e-04
Validation auc = 0.734693
Epoch 666
Validation auc = 0.732779
Epoch 667
Validation auc = 0.732779
Epoch 668
Validation auc = 0.737153
Epoch 669
Loss = 5.0045e-02, PNorm = 94.7349, GNorm = 1.5239, lr_0 = 9.6722e-04
Loss = 1.8895e-01, PNorm = 94.7443, GNorm = 9.1501, lr_0 = 9.6720e-04
Validation auc = 0.736333
Epoch 670
Validation auc = 0.730374
Epoch 671
Validation auc = 0.724579
Epoch 672
Validation auc = 0.718019
Epoch 673
Validation auc = 0.712771
Epoch 674
Loss = 3.3653e-02, PNorm = 94.9543, GNorm = 0.4149, lr_0 = 9.6696e-04
Validation auc = 0.712935
Epoch 675
Validation auc = 0.713044
Epoch 676
Validation auc = 0.711076
Epoch 677
Validation auc = 0.705828
Epoch 678
Validation auc = 0.693035
Epoch 679
Loss = 2.0133e-01, PNorm = 95.1876, GNorm = 1.3282, lr_0 = 9.6672e-04
Validation auc = 0.687896
Epoch 680
Validation auc = 0.681445
Epoch 681
Validation auc = 0.685108
Epoch 682
Validation auc = 0.683523
Epoch 683
Loss = 9.1995e-03, PNorm = 95.3949, GNorm = 0.0583, lr_0 = 9.6648e-04
Validation auc = 0.682812
Epoch 684
Validation auc = 0.680953
Epoch 685
Validation auc = 0.679641
Epoch 686
Validation auc = 0.682211
Epoch 687
Validation auc = 0.686475
Epoch 688
Loss = 2.1082e-02, PNorm = 95.5298, GNorm = 0.4873, lr_0 = 9.6624e-04
Loss = 1.1625e-02, PNorm = 95.5372, GNorm = 0.1710, lr_0 = 9.6622e-04
Validation auc = 0.689154
Epoch 689
Validation auc = 0.690684
Epoch 690
Validation auc = 0.693035
Epoch 691
Validation auc = 0.695714
Epoch 692
Validation auc = 0.696971
Epoch 693
Loss = 4.2854e-03, PNorm = 95.6181, GNorm = 0.0870, lr_0 = 9.6600e-04
Validation auc = 0.697299
Epoch 694
Validation auc = 0.697682
Epoch 695
Validation auc = 0.698065
Epoch 696
Validation auc = 0.698338
Epoch 697
Validation auc = 0.699049
Epoch 698
Loss = 1.2434e-02, PNorm = 95.6937, GNorm = 2.0688, lr_0 = 9.6574e-04
Validation auc = 0.699759
Epoch 699
Validation auc = 0.698939
Epoch 700
Validation auc = 0.699322
Epoch 701
Validation auc = 0.700470
Epoch 702
Loss = 1.3018e-03, PNorm = 95.7654, GNorm = 0.0889, lr_0 = 9.6552e-04
Loss = 2.0146e-05, PNorm = 95.7694, GNorm = 0.0007, lr_0 = 9.6550e-04
Validation auc = 0.700251
Epoch 703
Validation auc = 0.699103
Epoch 704
Validation auc = 0.698721
Epoch 705
Validation auc = 0.697901
Epoch 706
Validation auc = 0.696370
Epoch 707
Loss = 3.8830e-03, PNorm = 95.7931, GNorm = 0.4631, lr_0 = 9.6526e-04
Loss = 6.1659e-03, PNorm = 95.7952, GNorm = 0.3427, lr_0 = 9.6525e-04
Validation auc = 0.694785
Epoch 708
Validation auc = 0.698393
Epoch 709
Validation auc = 0.701509
Epoch 710
Validation auc = 0.704680
Epoch 711
Validation auc = 0.707850
Epoch 712
Loss = 3.3847e-04, PNorm = 95.8223, GNorm = 0.0068, lr_0 = 9.6502e-04
Validation auc = 0.708233
Epoch 713
Validation auc = 0.706702
Epoch 714
Validation auc = 0.704297
Epoch 715
Validation auc = 0.702657
Epoch 716
Loss = 5.2152e-04, PNorm = 95.8351, GNorm = 0.0031, lr_0 = 9.6479e-04
Validation auc = 0.702438
Epoch 717
Validation auc = 0.701400
Epoch 718
Validation auc = 0.700579
Epoch 719
Validation auc = 0.699869
Epoch 720
Validation auc = 0.699814
Epoch 721
Loss = 2.3765e-02, PNorm = 95.8560, GNorm = 1.5543, lr_0 = 9.6455e-04
Loss = 1.7983e-02, PNorm = 95.8615, GNorm = 1.8414, lr_0 = 9.6453e-04
Validation auc = 0.700579
Epoch 722
Validation auc = 0.699049
Epoch 723
Validation auc = 0.698775
Epoch 724
Validation auc = 0.698666
Epoch 725
Validation auc = 0.698229
Epoch 726
Loss = 5.4816e-03, PNorm = 95.9313, GNorm = 0.3634, lr_0 = 9.6431e-04
Validation auc = 0.696862
Epoch 727
Validation auc = 0.693473
Epoch 728
Validation auc = 0.693090
Epoch 729
Validation auc = 0.693965
Epoch 730
Validation auc = 0.696971
Epoch 731
Loss = 2.3389e-04, PNorm = 95.9798, GNorm = 0.0046, lr_0 = 9.6405e-04
Validation auc = 0.698065
Epoch 732
Validation auc = 0.700415
Epoch 733
Validation auc = 0.702384
Epoch 734
Validation auc = 0.705062
Epoch 735
Loss = 3.9783e-03, PNorm = 95.9943, GNorm = 0.0046, lr_0 = 9.6383e-04
Loss = 7.5648e-05, PNorm = 95.9949, GNorm = 0.0020, lr_0 = 9.6381e-04
Validation auc = 0.710475
Epoch 736
Validation auc = 0.714192
Epoch 737
Validation auc = 0.717089
Epoch 738
Validation auc = 0.719222
Epoch 739
Validation auc = 0.720424
Epoch 740
Loss = 2.1354e-03, PNorm = 96.0103, GNorm = 0.0317, lr_0 = 9.6357e-04
Loss = 1.1793e-03, PNorm = 96.0118, GNorm = 0.0304, lr_0 = 9.6355e-04
Validation auc = 0.720643
Epoch 741
Validation auc = 0.721026
Epoch 742
Validation auc = 0.721463
Epoch 743
Validation auc = 0.721572
Epoch 744
Validation auc = 0.722228
Epoch 745
Loss = 8.8903e-04, PNorm = 96.0323, GNorm = 0.0232, lr_0 = 9.6333e-04
Validation auc = 0.722556
Epoch 746
Validation auc = 0.722884
Epoch 747
Validation auc = 0.723212
Epoch 748
Validation auc = 0.723486
Epoch 749
Loss = 1.7624e-03, PNorm = 96.0506, GNorm = 0.0704, lr_0 = 9.6309e-04
Validation auc = 0.723704
Epoch 750
Validation auc = 0.723814
Epoch 751
Validation auc = 0.722611
Epoch 752
Validation auc = 0.722174
Epoch 753
Validation auc = 0.722338
Epoch 754
Loss = 8.2390e-04, PNorm = 96.0591, GNorm = 0.0187, lr_0 = 9.6285e-04
Loss = 2.1531e-03, PNorm = 96.0601, GNorm = 0.0471, lr_0 = 9.6284e-04
Validation auc = 0.722611
Epoch 755
Validation auc = 0.722502
Epoch 756
Validation auc = 0.722502
Epoch 757
Validation auc = 0.723431
Epoch 758
Validation auc = 0.722556
Epoch 759
Loss = 7.9771e-04, PNorm = 96.0666, GNorm = 0.0189, lr_0 = 9.6262e-04
Validation auc = 0.721190
Epoch 760
Validation auc = 0.720698
Epoch 761
Validation auc = 0.720479
Epoch 762
Validation auc = 0.720370
Epoch 763
Validation auc = 0.721354
Epoch 764
Loss = 1.9686e-03, PNorm = 96.0790, GNorm = 0.0538, lr_0 = 9.6236e-04
Validation auc = 0.719550
Epoch 765
Validation auc = 0.717035
Epoch 766
Validation auc = 0.714575
Epoch 767
Validation auc = 0.712935
Epoch 768
Loss = 2.4696e-03, PNorm = 96.0956, GNorm = 0.1877, lr_0 = 9.6214e-04
Loss = 6.8996e-03, PNorm = 96.0977, GNorm = 0.4208, lr_0 = 9.6212e-04
Validation auc = 0.711787
Epoch 769
Validation auc = 0.710967
Epoch 770
Validation auc = 0.709709
Epoch 771
Validation auc = 0.708506
Epoch 772
Validation auc = 0.707304
Epoch 773
Loss = 2.3472e-03, PNorm = 96.1261, GNorm = 0.3789, lr_0 = 9.6188e-04
Loss = 3.4136e-04, PNorm = 96.1281, GNorm = 0.0183, lr_0 = 9.6186e-04
Validation auc = 0.707796
Epoch 774
Validation auc = 0.709928
Epoch 775
Validation auc = 0.711349
Epoch 776
Validation auc = 0.712169
Epoch 777
Validation auc = 0.712607
Epoch 778
Loss = 5.0763e-04, PNorm = 96.1504, GNorm = 0.0196, lr_0 = 9.6164e-04
Validation auc = 0.713263
Epoch 779
Validation auc = 0.713536
Epoch 780
Validation auc = 0.713591
Epoch 781
Validation auc = 0.714192
Epoch 782
Validation auc = 0.714301
Epoch 783
Loss = 3.4254e-04, PNorm = 96.1663, GNorm = 0.0093, lr_0 = 9.6139e-04
Validation auc = 0.714575
Epoch 784
Validation auc = 0.714629
Epoch 785
Validation auc = 0.715941
Epoch 786
Validation auc = 0.717035
Epoch 787
Loss = 4.5353e-04, PNorm = 96.1816, GNorm = 0.0270, lr_0 = 9.6117e-04
Loss = 1.0932e-04, PNorm = 96.1828, GNorm = 0.0034, lr_0 = 9.6115e-04
Validation auc = 0.717199
Epoch 788
Validation auc = 0.717472
Epoch 789
Validation auc = 0.717855
Epoch 790
Validation auc = 0.718073
Epoch 791
Validation auc = 0.718347
Epoch 792
Loss = 1.7126e-04, PNorm = 96.1949, GNorm = 0.0048, lr_0 = 9.6093e-04
Validation auc = 0.718511
Epoch 793
Validation auc = 0.718347
Epoch 794
Validation auc = 0.718456
Epoch 795
Validation auc = 0.718347
Epoch 796
Validation auc = 0.718620
Epoch 797
Loss = 2.2829e-04, PNorm = 96.2060, GNorm = 0.0047, lr_0 = 9.6067e-04
Validation auc = 0.718565
Epoch 798
Validation auc = 0.718620
Epoch 799
Validation auc = 0.718565
Epoch 800
Validation auc = 0.719276
Epoch 801
Loss = 2.0975e-04, PNorm = 96.2213, GNorm = 0.0087, lr_0 = 9.6045e-04
Loss = 2.4239e-06, PNorm = 96.2225, GNorm = 0.0001, lr_0 = 9.6043e-04
Validation auc = 0.719440
Epoch 802
Validation auc = 0.719604
Epoch 803
Validation auc = 0.719495
Epoch 804
Validation auc = 0.719112
Epoch 805
Validation auc = 0.717035
Epoch 806
Loss = 2.5164e-04, PNorm = 96.2340, GNorm = 0.0132, lr_0 = 9.6019e-04
Loss = 6.7242e-05, PNorm = 96.2353, GNorm = 0.0057, lr_0 = 9.6018e-04
Validation auc = 0.710338
Epoch 807
Validation auc = 0.710666
Epoch 808
Validation auc = 0.710256
Epoch 809
Validation auc = 0.715559
Epoch 810
Validation auc = 0.715777
Epoch 811
Loss = 1.0205e-03, PNorm = 96.2513, GNorm = 0.0608, lr_0 = 9.5996e-04
Validation auc = 0.720916
Epoch 812
Validation auc = 0.725016
Epoch 813
Validation auc = 0.727039
Epoch 814
Validation auc = 0.731303
Epoch 815
Validation auc = 0.732178
Epoch 816
Loss = 9.2984e-04, PNorm = 96.2843, GNorm = 0.0196, lr_0 = 9.5970e-04
Validation auc = 0.735349
Epoch 817
Validation auc = 0.736442
Epoch 818
Validation auc = 0.737426
Epoch 819
Validation auc = 0.736716
Epoch 820
Loss = 6.5670e-04, PNorm = 96.3114, GNorm = 0.0317, lr_0 = 9.5948e-04
Loss = 9.7068e-05, PNorm = 96.3133, GNorm = 0.0045, lr_0 = 9.5946e-04
Validation auc = 0.735950
Epoch 821
Validation auc = 0.735403
Epoch 822
Validation auc = 0.735075
Epoch 823
Validation auc = 0.749672
Epoch 824
Validation auc = 0.765772
Epoch 825
Loss = 8.8637e-05, PNorm = 96.3420, GNorm = 0.0018, lr_0 = 9.5924e-04
Validation auc = 0.739066
Epoch 826
Validation auc = 0.706921
Epoch 827
Validation auc = 0.680953
Epoch 828
Validation auc = 0.688552
Epoch 829
Validation auc = 0.700361
Epoch 830
Loss = 4.9526e-04, PNorm = 96.3721, GNorm = 0.0117, lr_0 = 9.5899e-04
Validation auc = 0.703040
Epoch 831
Validation auc = 0.702110
Epoch 832
Validation auc = 0.700689
Epoch 833
Validation auc = 0.693309
Epoch 834
Loss = 5.6179e-03, PNorm = 96.4263, GNorm = 0.2386, lr_0 = 9.5877e-04
Loss = 5.0212e-04, PNorm = 96.4306, GNorm = 0.0204, lr_0 = 9.5875e-04
Validation auc = 0.690411
Epoch 835
Validation auc = 0.692325
Epoch 836
Validation auc = 0.692215
Epoch 837
Validation auc = 0.692653
Epoch 838
Validation auc = 0.692707
Epoch 839
Loss = 3.5894e-03, PNorm = 96.4950, GNorm = 0.2036, lr_0 = 9.5851e-04
Loss = 6.0658e-04, PNorm = 96.4991, GNorm = 0.0200, lr_0 = 9.5849e-04
Validation auc = 0.693363
Epoch 840
Validation auc = 0.693746
Epoch 841
Validation auc = 0.693910
Epoch 842
Validation auc = 0.693855
Epoch 843
Validation auc = 0.694019
Epoch 844
Loss = 1.5898e-04, PNorm = 96.5342, GNorm = 0.0049, lr_0 = 9.5827e-04
Validation auc = 0.694457
Epoch 845
Validation auc = 0.697518
Epoch 846
Validation auc = 0.700087
Epoch 847
Validation auc = 0.701782
Epoch 848
Validation auc = 0.701509
Epoch 849
Loss = 8.5849e-04, PNorm = 96.5578, GNorm = 0.0254, lr_0 = 9.5802e-04
Validation auc = 0.702165
Epoch 850
Validation auc = 0.700197
Epoch 851
Validation auc = 0.699814
Epoch 852
Validation auc = 0.699213
Epoch 853
Loss = 2.5971e-04, PNorm = 96.5825, GNorm = 0.0059, lr_0 = 9.5780e-04
Loss = 8.5672e-05, PNorm = 96.5839, GNorm = 0.0028, lr_0 = 9.5778e-04
Validation auc = 0.698338
Epoch 854
Validation auc = 0.702220
Epoch 855
Validation auc = 0.703149
Epoch 856
Validation auc = 0.699705
Epoch 857
Validation auc = 0.697955
Epoch 858
Loss = 4.9817e-04, PNorm = 96.6084, GNorm = 0.0264, lr_0 = 9.5754e-04
Validation auc = 0.695331
Epoch 859
Validation auc = 0.694074
Epoch 860
Validation auc = 0.692325
Epoch 861
Validation auc = 0.693527
Epoch 862
Validation auc = 0.696807
Epoch 863
Loss = 4.1454e-04, PNorm = 96.6291, GNorm = 0.0122, lr_0 = 9.5730e-04
Validation auc = 0.698447
Epoch 864
Validation auc = 0.698994
Epoch 865
Validation auc = 0.696862
Epoch 866
Validation auc = 0.695933
Epoch 867
Loss = 7.7863e-04, PNorm = 96.6490, GNorm = 0.0170, lr_0 = 9.5708e-04
Loss = 5.9078e-03, PNorm = 96.6509, GNorm = 0.2234, lr_0 = 9.5707e-04
Validation auc = 0.696315
Epoch 868
Validation auc = 0.696370
Epoch 869
Validation auc = 0.696479
Epoch 870
Validation auc = 0.697245
Epoch 871
Validation auc = 0.697518
Epoch 872
Loss = 6.5705e-04, PNorm = 96.6694, GNorm = 0.0472, lr_0 = 9.5683e-04
Loss = 3.2431e-04, PNorm = 96.6703, GNorm = 0.0122, lr_0 = 9.5681e-04
Validation auc = 0.697573
Epoch 873
Validation auc = 0.697245
Epoch 874
Validation auc = 0.697846
Epoch 875
Validation auc = 0.698393
Epoch 876
Validation auc = 0.698885
Epoch 877
Loss = 1.1465e-04, PNorm = 96.6867, GNorm = 0.0029, lr_0 = 9.5659e-04
Validation auc = 0.698775
Epoch 878
Validation auc = 0.701400
Epoch 879
Validation auc = 0.702493
Epoch 880
Validation auc = 0.703204
Epoch 881
Validation auc = 0.703641
Epoch 882
Loss = 3.6420e-04, PNorm = 96.7018, GNorm = 0.0283, lr_0 = 9.5634e-04
Validation auc = 0.703969
Epoch 883
Validation auc = 0.699049
Epoch 884
Validation auc = 0.696589
Epoch 885
Validation auc = 0.692325
Epoch 886
Loss = 3.9718e-03, PNorm = 96.7097, GNorm = 0.0048, lr_0 = 9.5612e-04
Loss = 2.3347e-04, PNorm = 96.7115, GNorm = 0.0166, lr_0 = 9.5610e-04
Validation auc = 0.690192
Epoch 887
Validation auc = 0.687459
Epoch 888
Validation auc = 0.685546
Epoch 889
Validation auc = 0.682867
Epoch 890
Validation auc = 0.681937
Epoch 891
Loss = 4.6836e-02, PNorm = 96.7290, GNorm = 0.0225, lr_0 = 9.5586e-04
Validation auc = 0.683851
Epoch 892
Validation auc = 0.686202
Epoch 893
Validation auc = 0.678821
Epoch 894
Validation auc = 0.673245
Epoch 895
Validation auc = 0.670621
Epoch 896
Loss = 3.1716e-04, PNorm = 96.7479, GNorm = 0.0091, lr_0 = 9.5563e-04
Validation auc = 0.671168
Epoch 897
Validation auc = 0.671168
Epoch 898
Validation auc = 0.672644
Epoch 899
Validation auc = 0.672589
Epoch 900
Loss = 4.2644e-03, PNorm = 96.7771, GNorm = 0.0203, lr_0 = 9.5541e-04
Loss = 6.0455e-03, PNorm = 96.7801, GNorm = 0.4534, lr_0 = 9.5539e-04
Validation auc = 0.672534
Epoch 901
Validation auc = 0.672589
Epoch 902
Validation auc = 0.672917
Epoch 903
Validation auc = 0.673409
Epoch 904
Validation auc = 0.673409
Epoch 905
Loss = 1.5131e-04, PNorm = 96.8107, GNorm = 0.0039, lr_0 = 9.5515e-04
Loss = 8.0973e-04, PNorm = 96.8121, GNorm = 0.0266, lr_0 = 9.5513e-04
Validation auc = 0.672972
Epoch 906
Validation auc = 0.673464
Epoch 907
Validation auc = 0.673190
Epoch 908
Validation auc = 0.673300
Epoch 909
Validation auc = 0.673190
Epoch 910
Loss = 1.0852e-04, PNorm = 96.8238, GNorm = 0.0024, lr_0 = 9.5491e-04
Validation auc = 0.672972
Epoch 911
Validation auc = 0.673409
Epoch 912
Validation auc = 0.674776
Epoch 913
Validation auc = 0.677509
Epoch 914
Validation auc = 0.681500
Epoch 915
Loss = 2.2156e-02, PNorm = 96.8632, GNorm = 0.4705, lr_0 = 9.5466e-04
Validation auc = 0.688990
Epoch 916
Validation auc = 0.704516
Epoch 917
Validation auc = 0.718292
Epoch 918
Validation auc = 0.732178
Epoch 919
Loss = 3.6387e-02, PNorm = 96.9686, GNorm = 1.3075, lr_0 = 9.5444e-04
Loss = 8.4409e-04, PNorm = 96.9777, GNorm = 0.0305, lr_0 = 9.5442e-04
Validation auc = 0.744588
Epoch 920
Validation auc = 0.752077
Epoch 921
Validation auc = 0.756834
Epoch 922
Validation auc = 0.760168
Epoch 923
Validation auc = 0.765034
Epoch 924
Loss = 1.0375e-02, PNorm = 97.2107, GNorm = 0.0879, lr_0 = 9.5419e-04
Validation auc = 0.763120
Epoch 925
Validation auc = 0.753280
Epoch 926
Validation auc = 0.744424
Epoch 927
Validation auc = 0.740870
Epoch 928
Validation auc = 0.739340
Epoch 929
Loss = 1.5214e-03, PNorm = 97.3866, GNorm = 0.0534, lr_0 = 9.5395e-04
Validation auc = 0.738902
Epoch 930
Validation auc = 0.738574
Epoch 931
Validation auc = 0.735458
Epoch 932
Validation auc = 0.731905
Epoch 933
Loss = 1.4770e-04, PNorm = 97.5086, GNorm = 0.0019, lr_0 = 9.5371e-04
Validation auc = 0.728953
Epoch 934
Validation auc = 0.765745
Epoch 935
Validation auc = 0.775804
Epoch 936
Validation auc = 0.779630
Epoch 937
Validation auc = 0.777170
Epoch 938
Loss = 1.2805e-02, PNorm = 97.6799, GNorm = 0.1074, lr_0 = 9.5348e-04
Loss = 6.5882e-03, PNorm = 97.6953, GNorm = 0.1370, lr_0 = 9.5346e-04
Validation auc = 0.772141
Epoch 939
Validation auc = 0.766510
Epoch 940
Validation auc = 0.758364
Epoch 941
Validation auc = 0.737153
Epoch 942
Validation auc = 0.721846
Epoch 943
Loss = 1.3275e-02, PNorm = 97.8915, GNorm = 0.2346, lr_0 = 9.5324e-04
Validation auc = 0.714903
Epoch 944
Validation auc = 0.710912
Epoch 945
Validation auc = 0.708288
Epoch 946
Validation auc = 0.712443
Epoch 947
Validation auc = 0.715231
Epoch 948
Loss = 1.8385e-04, PNorm = 98.0655, GNorm = 0.0068, lr_0 = 9.5299e-04
Validation auc = 0.717253
Epoch 949
Validation auc = 0.717472
Epoch 950
Validation auc = 0.718675
Epoch 951
Validation auc = 0.720096
Epoch 952
Loss = 4.1041e-04, PNorm = 98.1354, GNorm = 0.0443, lr_0 = 9.5277e-04
Loss = 3.9736e-08, PNorm = 98.1386, GNorm = 0.0000, lr_0 = 9.5275e-04
Validation auc = 0.720479
Epoch 953
Validation auc = 0.723103
Epoch 954
Validation auc = 0.722939
Epoch 955
Validation auc = 0.728789
Epoch 956
Validation auc = 0.728297
Epoch 957
Loss = 5.8093e-02, PNorm = 98.1960, GNorm = 0.0311, lr_0 = 9.5251e-04
Loss = 3.8144e-05, PNorm = 98.2049, GNorm = 0.0020, lr_0 = 9.5250e-04
Validation auc = 0.727969
Epoch 958
Validation auc = 0.723103
Epoch 959
Validation auc = 0.717691
Epoch 960
Validation auc = 0.719550
Epoch 961
Validation auc = 0.721572
Epoch 962
Loss = 3.4731e-04, PNorm = 98.3258, GNorm = 0.0100, lr_0 = 9.5228e-04
Validation auc = 0.722720
Epoch 963
Validation auc = 0.726930
Epoch 964
Validation auc = 0.728734
Epoch 965
Validation auc = 0.731577
Epoch 966
Loss = 1.3580e-02, PNorm = 98.4187, GNorm = 0.0026, lr_0 = 9.5204e-04
Validation auc = 0.730429
Epoch 967
Validation auc = 0.728078
Epoch 968
Validation auc = 0.727969
Epoch 969
Validation auc = 0.730866
Epoch 970
Validation auc = 0.734091
Epoch 971
Loss = 2.0092e-02, PNorm = 98.5181, GNorm = 0.4123, lr_0 = 9.5180e-04
Loss = 2.6504e-03, PNorm = 98.5288, GNorm = 0.0735, lr_0 = 9.5179e-04
Validation auc = 0.733162
Epoch 972
Validation auc = 0.731905
Epoch 973
Validation auc = 0.729445
Epoch 974
Validation auc = 0.725180
Epoch 975
Validation auc = 0.717308
Epoch 976
Loss = 2.5572e-03, PNorm = 98.6579, GNorm = 0.0612, lr_0 = 9.5157e-04
Validation auc = 0.711623
Epoch 977
Validation auc = 0.705062
Epoch 978
Validation auc = 0.694785
Epoch 979
Validation auc = 0.687568
Epoch 980
Validation auc = 0.684562
Epoch 981
Loss = 5.2657e-03, PNorm = 98.7399, GNorm = 0.4597, lr_0 = 9.5132e-04
Validation auc = 0.683906
Epoch 982
Validation auc = 0.678056
Epoch 983
Validation auc = 0.674667
Epoch 984
Validation auc = 0.672589
Epoch 985
Loss = 2.4113e-03, PNorm = 98.8015, GNorm = 0.0347, lr_0 = 9.5110e-04
Loss = 9.3067e-05, PNorm = 98.8062, GNorm = 0.0031, lr_0 = 9.5108e-04
Validation auc = 0.670730
Epoch 986
Validation auc = 0.669036
Epoch 987
Validation auc = 0.668325
Epoch 988
Validation auc = 0.666794
Epoch 989
Validation auc = 0.665482
Epoch 990
Loss = 5.6714e-02, PNorm = 98.8583, GNorm = 0.0306, lr_0 = 9.5084e-04
Loss = 4.5503e-04, PNorm = 98.8596, GNorm = 0.0155, lr_0 = 9.5083e-04
Validation auc = 0.662421
Epoch 991
Validation auc = 0.660671
Epoch 992
Validation auc = 0.659250
Epoch 993
Validation auc = 0.658977
Epoch 994
Validation auc = 0.657118
Epoch 995
Loss = 6.2723e-03, PNorm = 98.8797, GNorm = 0.1882, lr_0 = 9.5061e-04
Validation auc = 0.654876
Epoch 996
Validation auc = 0.655915
Epoch 997
Validation auc = 0.658649
Epoch 998
Validation auc = 0.660179
Epoch 999
Loss = 4.0832e-04, PNorm = 98.9094, GNorm = 0.0016, lr_0 = 9.5037e-04
Validation auc = 0.661437
Epoch 1000
Validation auc = 0.663514
Epoch 1001
Validation auc = 0.663569
Epoch 1002
Validation auc = 0.664115
Epoch 1003
Validation auc = 0.664279
Epoch 1004
Loss = 7.0730e-04, PNorm = 98.9382, GNorm = 0.0101, lr_0 = 9.5014e-04
Loss = 2.9629e-03, PNorm = 98.9402, GNorm = 0.1329, lr_0 = 9.5012e-04
Validation auc = 0.664990
Epoch 1005
Validation auc = 0.664935
Epoch 1006
Validation auc = 0.664771
Epoch 1007
Validation auc = 0.664935
Epoch 1008
Validation auc = 0.664935
Epoch 1009
Loss = 8.0867e-05, PNorm = 98.9625, GNorm = 0.0020, lr_0 = 9.4990e-04
Validation auc = 0.664881
Epoch 1010
Validation auc = 0.667177
Epoch 1011
Validation auc = 0.668325
Epoch 1012
Validation auc = 0.668708
Epoch 1013
Validation auc = 0.669254
Epoch 1014
Loss = 1.2321e-03, PNorm = 98.9857, GNorm = 0.0274, lr_0 = 9.4965e-04
Validation auc = 0.670047
Epoch 1015
Validation auc = 0.670840
Epoch 1016
Validation auc = 0.671058
Epoch 1017
Validation auc = 0.671277
Epoch 1018
Loss = 1.1791e-04, PNorm = 99.0076, GNorm = 0.0031, lr_0 = 9.4943e-04
Loss = 2.0841e-05, PNorm = 99.0092, GNorm = 0.0007, lr_0 = 9.4941e-04
Validation auc = 0.671332
Epoch 1019
Validation auc = 0.671222
Epoch 1020
Validation auc = 0.671332
Epoch 1021
Validation auc = 0.671332
Epoch 1022
Validation auc = 0.671386
Epoch 1023
Loss = 1.7713e-04, PNorm = 99.0289, GNorm = 0.0126, lr_0 = 9.4918e-04
Loss = 1.8682e-04, PNorm = 99.0301, GNorm = 0.0084, lr_0 = 9.4916e-04
Validation auc = 0.671168
Epoch 1024
Validation auc = 0.671277
Epoch 1025
Validation auc = 0.671113
Epoch 1026
Validation auc = 0.671004
Epoch 1027
Validation auc = 0.671058
Epoch 1028
Loss = 2.4985e-03, PNorm = 99.0419, GNorm = 0.1068, lr_0 = 9.4894e-04
Validation auc = 0.671332
Epoch 1029
Validation auc = 0.671386
Epoch 1030
Validation auc = 0.671168
Epoch 1031
Validation auc = 0.671222
Epoch 1032
Validation auc = 0.671058
Epoch 1033
Loss = 2.5512e-05, PNorm = 99.0547, GNorm = 0.0007, lr_0 = 9.4869e-04
Validation auc = 0.671058
Epoch 1034
Validation auc = 0.671004
Epoch 1035
Validation auc = 0.671168
Epoch 1036
Validation auc = 0.671605
Epoch 1037
Loss = 2.8027e-05, PNorm = 99.0627, GNorm = 0.0004, lr_0 = 9.4847e-04
Loss = 1.6828e-05, PNorm = 99.0633, GNorm = 0.0007, lr_0 = 9.4845e-04
Validation auc = 0.671496
Epoch 1038
Validation auc = 0.671441
Epoch 1039
Validation auc = 0.671441
Epoch 1040
Validation auc = 0.671113
Epoch 1041
Validation auc = 0.670894
Epoch 1042
Loss = 2.0774e-04, PNorm = 99.0699, GNorm = 0.0066, lr_0 = 9.4823e-04
Validation auc = 0.670840
Epoch 1043
Validation auc = 0.670621
Epoch 1044
Validation auc = 0.670512
Epoch 1045
Validation auc = 0.670348
Epoch 1046
Validation auc = 0.669965
Epoch 1047
Loss = 4.0133e-05, PNorm = 99.0864, GNorm = 0.0018, lr_0 = 9.4798e-04
Validation auc = 0.669637
Epoch 1048
Validation auc = 0.669692
Epoch 1049
Validation auc = 0.669582
Epoch 1050
Validation auc = 0.669637
Epoch 1051
Loss = 1.5663e-04, PNorm = 99.1003, GNorm = 0.0013, lr_0 = 9.4776e-04
Loss = 1.1921e-07, PNorm = 99.1011, GNorm = 0.0000, lr_0 = 9.4775e-04
Validation auc = 0.669637
Epoch 1052
Validation auc = 0.669692
Epoch 1053
Validation auc = 0.669692
Epoch 1054
Validation auc = 0.669910
Epoch 1055
Validation auc = 0.670074
Epoch 1056
Loss = 4.8148e-05, PNorm = 99.1121, GNorm = 0.0029, lr_0 = 9.4751e-04
Loss = 3.9736e-06, PNorm = 99.1127, GNorm = 0.0002, lr_0 = 9.4749e-04
Validation auc = 0.670129
Epoch 1057
Validation auc = 0.670074
Epoch 1058
Validation auc = 0.670402
Epoch 1059
Validation auc = 0.670348
Epoch 1060
Validation auc = 0.670402
Epoch 1061
Loss = 1.8459e-04, PNorm = 99.1185, GNorm = 0.0060, lr_0 = 9.4728e-04
Validation auc = 0.670348
Epoch 1062
Validation auc = 0.670457
Epoch 1063
Validation auc = 0.670402
Epoch 1064
Validation auc = 0.670457
Epoch 1065
Validation auc = 0.670512
Epoch 1066
Loss = 3.4708e-05, PNorm = 99.1246, GNorm = 0.0013, lr_0 = 9.4702e-04
Validation auc = 0.670676
Epoch 1067
Validation auc = 0.667177
Epoch 1068
Validation auc = 0.663077
Epoch 1069
Validation auc = 0.660835
Epoch 1070
Loss = 3.1072e-05, PNorm = 99.1337, GNorm = 0.0008, lr_0 = 9.4681e-04
Loss = 1.4901e-06, PNorm = 99.1344, GNorm = 0.0001, lr_0 = 9.4679e-04
Validation auc = 0.657774
Epoch 1071
Validation auc = 0.655915
Epoch 1072
Validation auc = 0.654658
Epoch 1073
Validation auc = 0.655806
Epoch 1074
Validation auc = 0.656626
Epoch 1075
Loss = 1.2458e-05, PNorm = 99.1476, GNorm = 0.0003, lr_0 = 9.4657e-04
Validation auc = 0.656954
Epoch 1076
Validation auc = 0.657118
Epoch 1077
Validation auc = 0.657774
Epoch 1078
Validation auc = 0.653236
Epoch 1079
Validation auc = 0.678985
Epoch 1080
Loss = 8.8346e-03, PNorm = 99.2404, GNorm = 0.4549, lr_0 = 9.4632e-04
Validation auc = 0.691012
Epoch 1081
Validation auc = 0.699923
Epoch 1082
Validation auc = 0.719878
Epoch 1083
Validation auc = 0.735075
Epoch 1084
Loss = 6.9409e-02, PNorm = 99.5982, GNorm = 1.0161, lr_0 = 9.4610e-04
Loss = 4.1834e-02, PNorm = 99.6277, GNorm = 0.3777, lr_0 = 9.4608e-04
Validation auc = 0.730647
Epoch 1085
Validation auc = 0.723048
Epoch 1086
Validation auc = 0.712880
Epoch 1087
Validation auc = 0.701181
Epoch 1088
Validation auc = 0.708670
Epoch 1089
Loss = 7.6997e-03, PNorm = 100.0205, GNorm = 0.4051, lr_0 = 9.4585e-04
Loss = 2.2089e-03, PNorm = 100.0441, GNorm = 0.0643, lr_0 = 9.4583e-04
Validation auc = 0.710748
Epoch 1090
Validation auc = 0.713973
Epoch 1091
Validation auc = 0.718292
Epoch 1092
Validation auc = 0.718839
Epoch 1093
Validation auc = 0.717964
Epoch 1094
Loss = 5.8484e-03, PNorm = 100.2538, GNorm = 0.5826, lr_0 = 9.4561e-04
Validation auc = 0.714793
Epoch 1095
Validation auc = 0.713427
Epoch 1096
Validation auc = 0.710201
Epoch 1097
Validation auc = 0.709436
Epoch 1098
Validation auc = 0.712060
Epoch 1099
Loss = 3.1308e-03, PNorm = 100.3793, GNorm = 0.2563, lr_0 = 9.4536e-04
Validation auc = 0.712771
Epoch 1100
Validation auc = 0.713481
Epoch 1101
Validation auc = 0.713919
Epoch 1102
Validation auc = 0.718729
Epoch 1103
Loss = 1.5046e-02, PNorm = 100.4434, GNorm = 0.7883, lr_0 = 9.4515e-04
Loss = 9.2478e-04, PNorm = 100.4498, GNorm = 0.0356, lr_0 = 9.4513e-04
Validation auc = 0.719878
Epoch 1104
Validation auc = 0.721354
Epoch 1105
Validation auc = 0.720260
Epoch 1106
Validation auc = 0.723486
Epoch 1107
Validation auc = 0.726711
Epoch 1108
Loss = 2.2164e-03, PNorm = 100.5699, GNorm = 0.0494, lr_0 = 9.4489e-04
Validation auc = 0.728515
Epoch 1109
Validation auc = 0.732834
Epoch 1110
Validation auc = 0.730210
Epoch 1111
Validation auc = 0.730811
Epoch 1112
Validation auc = 0.732779
Epoch 1113
Loss = 4.4399e-02, PNorm = 100.6372, GNorm = 1.2176, lr_0 = 9.4466e-04
Validation auc = 0.732506
Epoch 1114
Validation auc = 0.727586
Epoch 1115
Validation auc = 0.726000
Epoch 1116
Validation auc = 0.715941
Epoch 1117
Loss = 6.3524e-02, PNorm = 100.7056, GNorm = 0.7861, lr_0 = 9.4444e-04
Loss = 4.1008e-03, PNorm = 100.7106, GNorm = 0.3672, lr_0 = 9.4443e-04
Validation auc = 0.707632
Epoch 1118
Validation auc = 0.702329
Epoch 1119
Validation auc = 0.697955
Epoch 1120
Validation auc = 0.703149
Epoch 1121
Validation auc = 0.704844
Epoch 1122
Loss = 2.9253e-03, PNorm = 100.7889, GNorm = 0.0383, lr_0 = 9.4419e-04
Loss = 1.2670e-04, PNorm = 100.7939, GNorm = 0.0060, lr_0 = 9.4417e-04
Validation auc = 0.703532
Epoch 1123
Validation auc = 0.703696
Epoch 1124
Validation auc = 0.703805
Epoch 1125
Validation auc = 0.704953
Epoch 1126
Validation auc = 0.706101
Epoch 1127
Loss = 1.0045e-03, PNorm = 100.8425, GNorm = 0.0285, lr_0 = 9.4396e-04
Validation auc = 0.707085
Epoch 1128
Validation auc = 0.712388
Epoch 1129
Validation auc = 0.713700
Epoch 1130
Validation auc = 0.719222
Epoch 1131
Validation auc = 0.721244
Epoch 1132
Loss = 2.7913e-03, PNorm = 100.9892, GNorm = 0.1419, lr_0 = 9.4371e-04
Validation auc = 0.715996
Epoch 1133
Validation auc = 0.715613
Epoch 1134
Validation auc = 0.709709
Epoch 1135
Validation auc = 0.700142
Epoch 1136
Loss = 1.0840e-01, PNorm = 101.1539, GNorm = 6.1749, lr_0 = 9.4349e-04
Loss = 1.0324e-04, PNorm = 101.1682, GNorm = 0.0036, lr_0 = 9.4347e-04
Validation auc = 0.694129
Epoch 1137
Validation auc = 0.693363
Epoch 1138
Validation auc = 0.694129
Epoch 1139
Validation auc = 0.693801
Epoch 1140
Validation auc = 0.693910
Epoch 1141
Loss = 1.1040e-02, PNorm = 101.3505, GNorm = 0.5868, lr_0 = 9.4324e-04
Validation auc = 0.694129
Epoch 1142
Validation auc = 0.694074
Epoch 1143
Validation auc = 0.695058
Epoch 1144
Validation auc = 0.693145
Epoch 1145
Validation auc = 0.698174
Epoch 1146
Loss = 1.3250e-03, PNorm = 101.4560, GNorm = 0.0504, lr_0 = 9.4300e-04
Validation auc = 0.703586
Epoch 1147
Validation auc = 0.705226
Epoch 1148
Validation auc = 0.708889
Epoch 1149
Validation auc = 0.711951
Epoch 1150
Loss = 9.6920e-03, PNorm = 101.5541, GNorm = 0.0150, lr_0 = 9.4279e-04
Loss = 1.6797e-03, PNorm = 101.5625, GNorm = 0.1394, lr_0 = 9.4277e-04
Validation auc = 0.713317
Epoch 1151
Validation auc = 0.714520
Epoch 1152
Validation auc = 0.716433
Epoch 1153
Validation auc = 0.718347
Epoch 1154
Validation auc = 0.720424
Epoch 1155
Loss = 2.6903e-02, PNorm = 101.6518, GNorm = 0.0086, lr_0 = 9.4253e-04
Loss = 3.1975e-04, PNorm = 101.6550, GNorm = 0.0290, lr_0 = 9.4252e-04
Validation auc = 0.719604
Epoch 1156
Validation auc = 0.712552
Epoch 1157
Validation auc = 0.701618
Epoch 1158
Validation auc = 0.696151
Epoch 1159
Validation auc = 0.692543
Epoch 1160
Loss = 1.3528e-02, PNorm = 101.7534, GNorm = 0.6207, lr_0 = 9.4230e-04
Validation auc = 0.691012
Epoch 1161
Validation auc = 0.687732
Epoch 1162
Validation auc = 0.686803
Epoch 1163
Validation auc = 0.684890
Epoch 1164
Validation auc = 0.683632
Epoch 1165
Loss = 7.0238e-04, PNorm = 101.8302, GNorm = 0.0266, lr_0 = 9.4205e-04
Validation auc = 0.683140
Epoch 1166
Validation auc = 0.682757
Epoch 1167
Validation auc = 0.683195
Epoch 1168
Validation auc = 0.684398
Epoch 1169
Loss = 4.5312e-03, PNorm = 101.8729, GNorm = 0.1587, lr_0 = 9.4183e-04
Loss = 1.1012e-03, PNorm = 101.8762, GNorm = 0.0387, lr_0 = 9.4182e-04
Validation auc = 0.686202
Epoch 1170
Validation auc = 0.687787
Epoch 1171
Validation auc = 0.691723
Epoch 1172
Validation auc = 0.697463
Epoch 1173
Validation auc = 0.701564
Epoch 1174
Loss = 7.4837e-04, PNorm = 101.9170, GNorm = 0.0055, lr_0 = 9.4158e-04
Validation auc = 0.704898
Epoch 1175
Validation auc = 0.707522
Epoch 1176
Validation auc = 0.709873
Epoch 1177
Validation auc = 0.712333
Epoch 1178
Validation auc = 0.714137
Epoch 1179
Loss = 9.0762e-04, PNorm = 101.9471, GNorm = 0.0279, lr_0 = 9.4135e-04
Validation auc = 0.715285
Epoch 1180
Validation auc = 0.718183
Epoch 1181
Validation auc = 0.724415
Epoch 1182
Validation auc = 0.725180
Epoch 1183
Loss = 6.5571e-04, PNorm = 102.0035, GNorm = 0.0089, lr_0 = 9.4112e-04
Validation auc = 0.724251
Epoch 1184
Validation auc = 0.721955
Epoch 1185
Validation auc = 0.721463
Epoch 1186
Validation auc = 0.720479
Epoch 1187
Validation auc = 0.719768
Epoch 1188
Loss = 1.2941e-04, PNorm = 102.0597, GNorm = 0.0120, lr_0 = 9.4088e-04
Loss = 2.3305e-05, PNorm = 102.0621, GNorm = 0.0008, lr_0 = 9.4087e-04
Validation auc = 0.719823
Epoch 1189
Validation auc = 0.719495
Epoch 1190
Validation auc = 0.719386
Epoch 1191
Validation auc = 0.719604
Epoch 1192
Validation auc = 0.719550
Epoch 1193
Loss = 1.6732e-04, PNorm = 102.0827, GNorm = 0.0047, lr_0 = 9.4065e-04
Validation auc = 0.719495
Epoch 1194
Validation auc = 0.720479
Epoch 1195
Validation auc = 0.720752
Epoch 1196
Validation auc = 0.720916
Epoch 1197
Validation auc = 0.726438
Epoch 1198
Loss = 3.0247e-04, PNorm = 102.0920, GNorm = 0.0173, lr_0 = 9.4040e-04
Validation auc = 0.730155
Epoch 1199
Validation auc = 0.729663
Epoch 1200
Validation auc = 0.727586
Epoch 1201
Validation auc = 0.726164
Epoch 1202
Loss = 6.4941e-05, PNorm = 102.1232, GNorm = 0.0011, lr_0 = 9.4018e-04
Loss = 3.1590e-06, PNorm = 102.1256, GNorm = 0.0001, lr_0 = 9.4016e-04
Validation auc = 0.724743
Epoch 1203
Validation auc = 0.723486
Epoch 1204
Validation auc = 0.721354
Epoch 1205
Validation auc = 0.719714
Epoch 1206
Validation auc = 0.718292
Epoch 1207
Loss = 1.3383e-02, PNorm = 102.1591, GNorm = 0.4292, lr_0 = 9.3993e-04
Loss = 7.0684e-05, PNorm = 102.1641, GNorm = 0.0041, lr_0 = 9.3991e-04
Validation auc = 0.714739
Epoch 1208
Validation auc = 0.711021
Epoch 1209
Validation auc = 0.709326
Epoch 1210
Validation auc = 0.707194
Epoch 1211
Validation auc = 0.707468
Epoch 1212
Loss = 7.0025e-04, PNorm = 102.2036, GNorm = 0.0179, lr_0 = 9.3970e-04
Validation auc = 0.707194
Epoch 1213
Validation auc = 0.709490
Epoch 1214
Validation auc = 0.713481
Epoch 1215
Validation auc = 0.707194
Epoch 1216
Loss = 4.9297e-03, PNorm = 102.2196, GNorm = 0.0263, lr_0 = 9.3946e-04
Validation auc = 0.714465
Epoch 1217
Validation auc = 0.719768
Epoch 1218
Validation auc = 0.723212
Epoch 1219
Validation auc = 0.726000
Epoch 1220
Validation auc = 0.729773
Epoch 1221
Loss = 1.4692e-03, PNorm = 102.2406, GNorm = 0.0376, lr_0 = 9.3923e-04
Loss = 6.8137e-04, PNorm = 102.2426, GNorm = 0.0174, lr_0 = 9.3922e-04
Validation auc = 0.732725
Epoch 1222
Validation auc = 0.734365
Epoch 1223
Validation auc = 0.735239
Epoch 1224
Validation auc = 0.736606
Epoch 1225
Validation auc = 0.737481
Epoch 1226
Loss = 9.2155e-04, PNorm = 102.2671, GNorm = 0.0216, lr_0 = 9.3900e-04
Validation auc = 0.737918
Epoch 1227
Validation auc = 0.738410
Epoch 1228
Validation auc = 0.738902
Epoch 1229
Validation auc = 0.739012
Epoch 1230
Validation auc = 0.737044
Epoch 1231
Loss = 3.6656e-04, PNorm = 102.2876, GNorm = 0.0092, lr_0 = 9.3875e-04
Validation auc = 0.734255
Epoch 1232
Validation auc = 0.732506
Epoch 1233
Validation auc = 0.730866
Epoch 1234
Validation auc = 0.729007
Epoch 1235
Loss = 2.0584e-03, PNorm = 102.2949, GNorm = 0.0355, lr_0 = 9.3853e-04
Loss = 1.2978e-04, PNorm = 102.2956, GNorm = 0.0043, lr_0 = 9.3852e-04
Validation auc = 0.727586
Epoch 1236
Validation auc = 0.729882
Epoch 1237
Validation auc = 0.733490
Epoch 1238
Validation auc = 0.734365
Epoch 1239
Validation auc = 0.736661
Epoch 1240
Loss = 3.6866e-04, PNorm = 102.3120, GNorm = 0.0029, lr_0 = 9.3828e-04
Loss = 3.2642e-05, PNorm = 102.3132, GNorm = 0.0017, lr_0 = 9.3827e-04
Validation auc = 0.737809
Epoch 1241
Validation auc = 0.738192
Epoch 1242
Validation auc = 0.738848
Epoch 1243
Validation auc = 0.738465
Epoch 1244
Validation auc = 0.737481
Epoch 1245
Loss = 4.8268e-03, PNorm = 102.3189, GNorm = 0.1399, lr_0 = 9.3805e-04
Validation auc = 0.736661
Epoch 1246
Validation auc = 0.736442
Epoch 1247
Validation auc = 0.736661
Epoch 1248
Validation auc = 0.736661
Epoch 1249
Loss = 1.4597e-03, PNorm = 102.3309, GNorm = 0.0351, lr_0 = 9.3782e-04
Validation auc = 0.737590
Epoch 1250
Validation auc = 0.737372
Epoch 1251
Validation auc = 0.737809
Epoch 1252
Validation auc = 0.740214
Epoch 1253
Validation auc = 0.741089
Epoch 1254
Loss = 2.8211e-03, PNorm = 102.3718, GNorm = 0.0128, lr_0 = 9.3758e-04
Loss = 3.0595e-05, PNorm = 102.3755, GNorm = 0.0019, lr_0 = 9.3757e-04
Validation auc = 0.738137
Epoch 1255
Validation auc = 0.738082
Epoch 1256
Validation auc = 0.738301
Epoch 1257
Validation auc = 0.738301
Epoch 1258
Validation auc = 0.737973
Epoch 1259
Loss = 1.6317e-04, PNorm = 102.4157, GNorm = 0.0043, lr_0 = 9.3735e-04
Validation auc = 0.737700
Epoch 1260
Validation auc = 0.738028
Epoch 1261
Validation auc = 0.737918
Epoch 1262
Validation auc = 0.738137
Epoch 1263
Validation auc = 0.738356
Epoch 1264
Loss = 3.8988e-04, PNorm = 102.4371, GNorm = 0.0131, lr_0 = 9.3710e-04
Validation auc = 0.738465
Epoch 1265
Validation auc = 0.738465
Epoch 1266
Validation auc = 0.738137
Epoch 1267
Validation auc = 0.738192
Epoch 1268
Loss = 2.3437e-03, PNorm = 102.4466, GNorm = 0.0106, lr_0 = 9.3689e-04
Loss = 1.0530e-06, PNorm = 102.4479, GNorm = 0.0001, lr_0 = 9.3687e-04
Validation auc = 0.736442
Epoch 1269
Validation auc = 0.735458
Epoch 1270
Validation auc = 0.733709
Epoch 1271
Validation auc = 0.733107
Epoch 1272
Validation auc = 0.733107
Epoch 1273
Loss = 1.6588e-04, PNorm = 102.4634, GNorm = 0.0010, lr_0 = 9.3664e-04
Loss = 9.9341e-08, PNorm = 102.4641, GNorm = 0.0000, lr_0 = 9.3662e-04
Validation auc = 0.732451
Epoch 1274
Validation auc = 0.732397
Epoch 1275
Validation auc = 0.732123
Epoch 1276
Validation auc = 0.732069
Epoch 1277
Validation auc = 0.731905
Epoch 1278
Loss = 1.0214e-04, PNorm = 102.4716, GNorm = 0.0029, lr_0 = 9.3641e-04
Validation auc = 0.731741
Epoch 1279
Validation auc = 0.729609
Epoch 1280
Validation auc = 0.730210
Epoch 1281
Validation auc = 0.728953
Epoch 1282
Validation auc = 0.733709
Epoch 1283
Loss = 1.8599e-03, PNorm = 102.4702, GNorm = 0.0439, lr_0 = 9.3616e-04
Validation auc = 0.734857
Epoch 1284
Validation auc = 0.736333
Epoch 1285
Validation auc = 0.737153
Epoch 1286
Validation auc = 0.737044
Epoch 1287
Loss = 1.4586e-03, PNorm = 102.4992, GNorm = 0.0088, lr_0 = 9.3594e-04
Loss = 5.6522e-05, PNorm = 102.5014, GNorm = 0.0024, lr_0 = 9.3592e-04
Validation auc = 0.737098
Epoch 1288
Validation auc = 0.737317
Epoch 1289
Validation auc = 0.737317
Epoch 1290
Validation auc = 0.737973
Epoch 1291
Validation auc = 0.738520
Epoch 1292
Loss = 6.9627e-05, PNorm = 102.5250, GNorm = 0.0016, lr_0 = 9.3571e-04
Validation auc = 0.738957
Epoch 1293
Validation auc = 0.739340
Epoch 1294
Validation auc = 0.739340
Epoch 1295
Validation auc = 0.739558
Epoch 1296
Validation auc = 0.739449
Epoch 1297
Loss = 5.7648e-05, PNorm = 102.5428, GNorm = 0.0015, lr_0 = 9.3546e-04
Validation auc = 0.739394
Epoch 1298
Validation auc = 0.739613
Epoch 1299
Validation auc = 0.739394
Epoch 1300
Validation auc = 0.740160
Epoch 1301
Loss = 1.0570e-01, PNorm = 102.5957, GNorm = 4.5167, lr_0 = 9.3524e-04
Loss = 1.2841e+00, PNorm = 102.6141, GNorm = 21.8790, lr_0 = 9.3523e-04
Validation auc = 0.732670
Epoch 1302
Validation auc = 0.764542
Epoch 1303
Validation auc = 0.664389
Epoch 1304
Validation auc = 0.583534
Epoch 1305
Validation auc = 0.584244
Epoch 1306
Loss = 1.1907e-01, PNorm = 103.3555, GNorm = 0.6870, lr_0 = 9.3499e-04
Loss = 3.0251e-02, PNorm = 103.4180, GNorm = 0.4383, lr_0 = 9.3498e-04
Validation auc = 0.609829
Epoch 1307
Validation auc = 0.650503
Epoch 1308
Validation auc = 0.663131
Epoch 1309
Validation auc = 0.683906
Epoch 1310
Validation auc = 0.687623
Epoch 1311
Loss = 1.5315e-01, PNorm = 104.1588, GNorm = 0.8335, lr_0 = 9.3476e-04
Validation auc = 0.680899
Epoch 1312
Validation auc = 0.687186
Epoch 1313
Validation auc = 0.678001
Epoch 1314
Validation auc = 0.685710
Epoch 1315
Validation auc = 0.697081
Epoch 1316
Loss = 1.8618e-01, PNorm = 104.8301, GNorm = 1.3924, lr_0 = 9.3451e-04
Validation auc = 0.686639
Epoch 1317
Validation auc = 0.680516
Epoch 1318
Validation auc = 0.693965
Epoch 1319
Validation auc = 0.701181
Epoch 1320
Loss = 4.6323e-02, PNorm = 105.3403, GNorm = 1.6500, lr_0 = 9.3430e-04
Loss = 1.7164e-01, PNorm = 105.3681, GNorm = 5.0021, lr_0 = 9.3428e-04
Validation auc = 0.696315
Epoch 1321
Validation auc = 0.668489
Epoch 1322
Validation auc = 0.650175
Epoch 1323
Validation auc = 0.649738
Epoch 1324
Validation auc = 0.655970
Epoch 1325
Loss = 3.0921e-02, PNorm = 105.8070, GNorm = 0.6899, lr_0 = 9.3407e-04
Validation auc = 0.637656
Epoch 1326
Validation auc = 0.618631
Epoch 1327
Validation auc = 0.608736
Epoch 1328
Validation auc = 0.609611
Epoch 1329
Validation auc = 0.613164
Epoch 1330
Loss = 1.3969e-02, PNorm = 106.1747, GNorm = 0.2644, lr_0 = 9.3382e-04
Validation auc = 0.619888
Epoch 1331
Validation auc = 0.626777
Epoch 1332
Validation auc = 0.633446
Epoch 1333
Validation auc = 0.639569
Epoch 1334
Loss = 3.3791e-02, PNorm = 106.3712, GNorm = 0.0713, lr_0 = 9.3360e-04
Loss = 2.5469e-04, PNorm = 106.3833, GNorm = 0.0065, lr_0 = 9.3359e-04
Validation auc = 0.644599
Epoch 1335
Validation auc = 0.641647
Epoch 1336
Validation auc = 0.640280
Epoch 1337
Validation auc = 0.634321
Epoch 1338
Validation auc = 0.630166
Epoch 1339
Loss = 4.4642e-02, PNorm = 106.5382, GNorm = 0.6386, lr_0 = 9.3336e-04
Loss = 2.6936e-02, PNorm = 106.5496, GNorm = 0.5008, lr_0 = 9.3334e-04
Validation auc = 0.634540
Epoch 1340
Validation auc = 0.638913
Epoch 1341
Validation auc = 0.642631
Epoch 1342
Validation auc = 0.640936
Epoch 1343
Validation auc = 0.639569
Epoch 1344
Loss = 3.1140e-03, PNorm = 106.7041, GNorm = 0.0455, lr_0 = 9.3312e-04
Validation auc = 0.640007
Epoch 1345
Validation auc = 0.651542
Epoch 1346
Validation auc = 0.661300
Epoch 1347
Validation auc = 0.673081
Epoch 1348
Validation auc = 0.676361
Epoch 1349
Loss = 8.9261e-02, PNorm = 106.8435, GNorm = 2.9000, lr_0 = 9.3288e-04
Validation auc = 0.670184
Epoch 1350
Validation auc = 0.663514
Epoch 1351
Validation auc = 0.665045
Epoch 1352
Validation auc = 0.667396
Epoch 1353
Loss = 3.2065e-02, PNorm = 107.0329, GNorm = 1.8872, lr_0 = 9.3266e-04
Loss = 1.7397e-03, PNorm = 107.0453, GNorm = 0.0621, lr_0 = 9.3264e-04
Validation auc = 0.664170
Epoch 1354
Validation auc = 0.661491
Epoch 1355
Validation auc = 0.658703
Epoch 1356
Validation auc = 0.661710
Epoch 1357
Validation auc = 0.667450
Epoch 1358
Loss = 5.2848e-03, PNorm = 107.2061, GNorm = 0.0593, lr_0 = 9.3241e-04
Validation auc = 0.673081
Epoch 1359
Validation auc = 0.674995
Epoch 1360
Validation auc = 0.674557
Epoch 1361
Validation auc = 0.669473
Epoch 1362
Validation auc = 0.662530
Epoch 1363
Loss = 8.0497e-04, PNorm = 107.2993, GNorm = 0.0173, lr_0 = 9.3218e-04
Validation auc = 0.658047
Epoch 1364
Validation auc = 0.656735
Epoch 1365
Validation auc = 0.657118
Epoch 1366
Validation auc = 0.658758
Epoch 1367
Loss = 3.4940e-03, PNorm = 107.3638, GNorm = 0.1801, lr_0 = 9.3197e-04
Loss = 1.0208e-02, PNorm = 107.3690, GNorm = 0.7461, lr_0 = 9.3195e-04
Validation auc = 0.660125
Epoch 1368
Validation auc = 0.661382
Epoch 1369
Validation auc = 0.663077
Epoch 1370
Validation auc = 0.664006
Epoch 1371
Validation auc = 0.664607
Epoch 1372
Loss = 3.1309e-04, PNorm = 107.4303, GNorm = 0.0019, lr_0 = 9.3172e-04
Loss = 3.1853e-04, PNorm = 107.4334, GNorm = 0.0120, lr_0 = 9.3170e-04
Validation auc = 0.664771
Epoch 1373
Validation auc = 0.665373
Epoch 1374
Validation auc = 0.665209
Epoch 1375
Validation auc = 0.665318
Epoch 1376
Validation auc = 0.665537
Epoch 1377
Loss = 7.0184e-04, PNorm = 107.4672, GNorm = 0.0364, lr_0 = 9.3149e-04
Validation auc = 0.665373
Epoch 1378
Validation auc = 0.664717
Epoch 1379
Validation auc = 0.663897
Epoch 1380
Validation auc = 0.663733
Epoch 1381
Validation auc = 0.662913
Epoch 1382
Loss = 1.6384e-04, PNorm = 107.5031, GNorm = 0.0063, lr_0 = 9.3124e-04
Validation auc = 0.662803
Epoch 1383
Validation auc = 0.665428
Epoch 1384
Validation auc = 0.668161
Epoch 1385
Validation auc = 0.671277
Epoch 1386
Loss = 1.4727e-03, PNorm = 107.5285, GNorm = 0.0213, lr_0 = 9.3102e-04
Loss = 2.7239e-03, PNorm = 107.5306, GNorm = 0.2188, lr_0 = 9.3101e-04
Validation auc = 0.671496
Epoch 1387
Validation auc = 0.671769
Epoch 1388
Validation auc = 0.672152
Epoch 1389
Validation auc = 0.671769
Epoch 1390
Validation auc = 0.672480
Epoch 1391
Loss = 4.2809e-04, PNorm = 107.5518, GNorm = 0.0103, lr_0 = 9.3078e-04
Validation auc = 0.672480
Epoch 1392
Validation auc = 0.672316
Epoch 1393
Validation auc = 0.672152
Epoch 1394
Validation auc = 0.672316
Epoch 1395
Validation auc = 0.672316
Epoch 1396
Loss = 8.1384e-05, PNorm = 107.5643, GNorm = 0.0030, lr_0 = 9.3055e-04
Validation auc = 0.671824
Epoch 1397
Validation auc = 0.671550
Epoch 1398
Validation auc = 0.676881
Epoch 1399
Validation auc = 0.649683
Epoch 1400
Loss = 2.5677e-01, PNorm = 107.6746, GNorm = 0.0362, lr_0 = 9.3033e-04
Loss = 1.7251e-04, PNorm = 107.6969, GNorm = 0.0096, lr_0 = 9.3032e-04
Validation auc = 0.638312
Epoch 1401
Validation auc = 0.660398
Epoch 1402
Validation auc = 0.631916
Epoch 1403
Validation auc = 0.715613
Epoch 1404
Validation auc = 0.729335
Epoch 1405
Loss = 1.7258e-01, PNorm = 108.1003, GNorm = 2.0997, lr_0 = 9.3008e-04
Loss = 2.8221e-02, PNorm = 108.1326, GNorm = 0.5275, lr_0 = 9.3007e-04
Validation auc = 0.754756
Epoch 1406
Validation auc = 0.761918
Epoch 1407
Validation auc = 0.755522
Epoch 1408
Validation auc = 0.755850
Epoch 1409
Validation auc = 0.759020
Epoch 1410
Loss = 8.0195e-02, PNorm = 108.4726, GNorm = 1.3922, lr_0 = 9.2985e-04
Validation auc = 0.761972
Epoch 1411
Validation auc = 0.763941
Epoch 1412
Validation auc = 0.766291
Epoch 1413
Validation auc = 0.767275
Epoch 1414
Validation auc = 0.765854
Epoch 1415
Loss = 1.7195e-01, PNorm = 108.7227, GNorm = 1.4411, lr_0 = 9.2961e-04
Validation auc = 0.774492
Epoch 1416
Validation auc = 0.777826
Epoch 1417
Validation auc = 0.774109
Epoch 1418
Validation auc = 0.770883
Epoch 1419
Loss = 1.3742e-03, PNorm = 108.8218, GNorm = 0.0200, lr_0 = 9.2939e-04
Loss = 1.2154e-04, PNorm = 108.8266, GNorm = 0.0052, lr_0 = 9.2938e-04
Validation auc = 0.766783
Epoch 1420
Validation auc = 0.764050
Epoch 1421
Validation auc = 0.763503
Epoch 1422
Validation auc = 0.766893
Epoch 1423
Validation auc = 0.765253
Epoch 1424
Loss = 1.5801e-03, PNorm = 108.8864, GNorm = 0.0103, lr_0 = 9.2914e-04
Validation auc = 0.763886
Epoch 1425
Validation auc = 0.763613
Epoch 1426
Validation auc = 0.763503
Epoch 1427
Validation auc = 0.762246
Epoch 1428
Validation auc = 0.761152
Epoch 1429
Loss = 5.7378e-02, PNorm = 108.9387, GNorm = 2.3992, lr_0 = 9.2891e-04
Validation auc = 0.761152
Epoch 1430
Validation auc = 0.760004
Epoch 1431
Validation auc = 0.753280
Epoch 1432
Validation auc = 0.740214
Epoch 1433
Loss = 2.8976e-03, PNorm = 109.0079, GNorm = 0.1678, lr_0 = 9.2868e-04
Validation auc = 0.730429
Epoch 1434
Validation auc = 0.724852
Epoch 1435
Validation auc = 0.722064
Epoch 1436
Validation auc = 0.722119
Epoch 1437
Validation auc = 0.725508
Epoch 1438
Loss = 4.2016e-02, PNorm = 109.0653, GNorm = 2.0608, lr_0 = 9.2845e-04
Loss = 1.4727e-03, PNorm = 109.0680, GNorm = 0.0513, lr_0 = 9.2844e-04
Validation auc = 0.725727
Epoch 1439
Validation auc = 0.727148
Epoch 1440
Validation auc = 0.732178
Epoch 1441
Validation auc = 0.740105
Epoch 1442
Validation auc = 0.738192
Epoch 1443
Loss = 1.1362e-01, PNorm = 109.1221, GNorm = 1.6924, lr_0 = 9.2822e-04
Validation auc = 0.732451
Epoch 1444
Validation auc = 0.723103
Epoch 1445
Validation auc = 0.712169
Epoch 1446
Validation auc = 0.709326
Epoch 1447
Validation auc = 0.710748
Epoch 1448
Loss = 7.0795e-02, PNorm = 109.2559, GNorm = 0.9081, lr_0 = 9.2798e-04
Validation auc = 0.710529
Epoch 1449
Validation auc = 0.711841
Epoch 1450
Validation auc = 0.717199
Epoch 1451
Validation auc = 0.717636
Epoch 1452
Loss = 9.7309e-03, PNorm = 109.3907, GNorm = 1.2851, lr_0 = 9.2776e-04
Loss = 2.2193e-03, PNorm = 109.4016, GNorm = 0.1217, lr_0 = 9.2775e-04
Validation auc = 0.715176
Epoch 1453
Validation auc = 0.712607
Epoch 1454
Validation auc = 0.710201
Epoch 1455
Validation auc = 0.706866
Epoch 1456
Validation auc = 0.703750
Epoch 1457
Loss = 7.0664e-04, PNorm = 109.5185, GNorm = 0.0164, lr_0 = 9.2752e-04
Loss = 1.4291e-04, PNorm = 109.5239, GNorm = 0.0078, lr_0 = 9.2750e-04
Validation auc = 0.700908
Epoch 1458
Validation auc = 0.698666
Epoch 1459
Validation auc = 0.696151
Epoch 1460
Validation auc = 0.695058
Epoch 1461
Validation auc = 0.694019
Epoch 1462
Loss = 7.3776e-04, PNorm = 109.5687, GNorm = 0.0236, lr_0 = 9.2729e-04
Validation auc = 0.693691
Epoch 1463
Validation auc = 0.692981
Epoch 1464
Validation auc = 0.690794
Epoch 1465
Validation auc = 0.689700
Epoch 1466
Loss = 3.7394e-02, PNorm = 109.5915, GNorm = 14.2284, lr_0 = 9.2706e-04
Validation auc = 0.694566
Epoch 1467
Validation auc = 0.697737
Epoch 1468
Validation auc = 0.690083
Epoch 1469
Validation auc = 0.681008
Epoch 1470
Validation auc = 0.673792
Epoch 1471
Loss = 2.8598e-01, PNorm = 109.7209, GNorm = 2.5076, lr_0 = 9.2683e-04
Loss = 5.7336e-05, PNorm = 109.7271, GNorm = 0.0023, lr_0 = 9.2681e-04
Validation auc = 0.680899
Epoch 1472
Validation auc = 0.704078
Epoch 1473
Validation auc = 0.717691
Epoch 1474
Validation auc = 0.722994
Epoch 1475
Validation auc = 0.722884
Epoch 1476
Loss = 5.4045e-02, PNorm = 109.8544, GNorm = 0.9698, lr_0 = 9.2660e-04
Validation auc = 0.720862
Epoch 1477
Validation auc = 0.719495
Epoch 1478
Validation auc = 0.718347
Epoch 1479
Validation auc = 0.716925
Epoch 1480
Validation auc = 0.715176
Epoch 1481
Loss = 2.0204e-03, PNorm = 110.0114, GNorm = 0.0298, lr_0 = 9.2635e-04
Validation auc = 0.714739
Epoch 1482
Validation auc = 0.713208
Epoch 1483
Validation auc = 0.712607
Epoch 1484
Validation auc = 0.711787
Epoch 1485
Loss = 2.4161e-02, PNorm = 110.0788, GNorm = 0.0504, lr_0 = 9.2614e-04
Loss = 3.7676e-02, PNorm = 110.0854, GNorm = 2.6865, lr_0 = 9.2612e-04
Validation auc = 0.709545
Epoch 1486
Validation auc = 0.706320
Epoch 1487
Validation auc = 0.697764
Epoch 1488
Validation auc = 0.695003
Epoch 1489
Validation auc = 0.690739
Epoch 1490
Loss = 1.0263e-03, PNorm = 110.1714, GNorm = 0.0146, lr_0 = 9.2589e-04
Loss = 1.1392e-03, PNorm = 110.1767, GNorm = 0.0314, lr_0 = 9.2587e-04
Validation auc = 0.686584
Epoch 1491
Validation auc = 0.683086
Epoch 1492
Validation auc = 0.681992
Epoch 1493
Validation auc = 0.682156
Epoch 1494
Validation auc = 0.681336
Epoch 1495
Loss = 3.0715e-04, PNorm = 110.2241, GNorm = 0.0081, lr_0 = 9.2566e-04
Validation auc = 0.680899
Epoch 1496
Validation auc = 0.680953
Epoch 1497
Validation auc = 0.679368
Epoch 1498
Validation auc = 0.676908
Epoch 1499
Loss = 7.8438e-04, PNorm = 110.2509, GNorm = 0.0160, lr_0 = 9.2543e-04
Validation auc = 0.674940
Epoch 1500
Validation auc = 0.673245
Epoch 1501
Validation auc = 0.672261
Epoch 1502
Validation auc = 0.672753
Epoch 1503
Validation auc = 0.673081
Epoch 1504
Loss = 2.3008e-03, PNorm = 110.2687, GNorm = 0.1593, lr_0 = 9.2520e-04
Loss = 8.6822e-06, PNorm = 110.2697, GNorm = 0.0005, lr_0 = 9.2518e-04
Validation auc = 0.673682
Epoch 1505
Validation auc = 0.675541
Epoch 1506
Validation auc = 0.676197
Epoch 1507
Validation auc = 0.676908
Epoch 1508
Validation auc = 0.677564
Epoch 1509
Loss = 1.9887e-01, PNorm = 110.2801, GNorm = 1.6052, lr_0 = 9.2497e-04
Validation auc = 0.674885
Epoch 1510
Validation auc = 0.672042
Epoch 1511
Validation auc = 0.670512
Epoch 1512
Validation auc = 0.668981
Epoch 1513
Validation auc = 0.668653
Epoch 1514
Loss = 6.4057e-04, PNorm = 110.2920, GNorm = 0.0206, lr_0 = 9.2472e-04
Validation auc = 0.667724
Epoch 1515
Validation auc = 0.667177
Epoch 1516
Validation auc = 0.667177
Epoch 1517
Validation auc = 0.670621
Epoch 1518
Loss = 5.9663e-02, PNorm = 110.3077, GNorm = 0.7519, lr_0 = 9.2451e-04
Loss = 8.4487e-05, PNorm = 110.3092, GNorm = 0.0028, lr_0 = 9.2449e-04
Validation auc = 0.672972
Epoch 1519
Validation auc = 0.675213
Epoch 1520
Validation auc = 0.678275
Epoch 1521
Validation auc = 0.680407
Epoch 1522
Validation auc = 0.682593
Epoch 1523
Loss = 2.3008e-02, PNorm = 110.3358, GNorm = 0.0583, lr_0 = 9.2427e-04
Loss = 3.0671e-04, PNorm = 110.3391, GNorm = 0.0094, lr_0 = 9.2425e-04
Validation auc = 0.681281
Epoch 1524
Validation auc = 0.681336
Epoch 1525
Validation auc = 0.682047
Epoch 1526
Validation auc = 0.679368
Epoch 1527
Validation auc = 0.672808
Epoch 1528
Loss = 5.5872e-02, PNorm = 110.4279, GNorm = 1.3777, lr_0 = 9.2404e-04
Validation auc = 0.667669
Epoch 1529
Validation auc = 0.663022
Epoch 1530
Validation auc = 0.659523
Epoch 1531
Validation auc = 0.658922
Epoch 1532
Validation auc = 0.657446
Epoch 1533
Loss = 1.0558e-03, PNorm = 110.5009, GNorm = 0.0202, lr_0 = 9.2379e-04
Validation auc = 0.657719
Epoch 1534
Validation auc = 0.658375
Epoch 1535
Validation auc = 0.657009
Epoch 1536
Validation auc = 0.657282
Epoch 1537
Loss = 1.0437e-03, PNorm = 110.5237, GNorm = 0.0248, lr_0 = 9.2358e-04
Loss = 6.3487e-03, PNorm = 110.5251, GNorm = 0.1829, lr_0 = 9.2356e-04
Validation auc = 0.656462
Epoch 1538
Validation auc = 0.657938
Epoch 1539
Validation auc = 0.658102
Epoch 1540
Validation auc = 0.659250
Epoch 1541
Validation auc = 0.661546
Epoch 1542
Loss = 7.9321e-04, PNorm = 110.5516, GNorm = 0.0254, lr_0 = 9.2335e-04
Validation auc = 0.679532
Epoch 1543
Validation auc = 0.689646
Epoch 1544
Validation auc = 0.699650
Epoch 1545
Validation auc = 0.704352
Epoch 1546
Validation auc = 0.706702
Epoch 1547
Loss = 1.4508e-03, PNorm = 110.6397, GNorm = 0.0690, lr_0 = 9.2310e-04
Validation auc = 0.708124
Epoch 1548
Validation auc = 0.709873
Epoch 1549
Validation auc = 0.709326
Epoch 1550
Validation auc = 0.713481
Epoch 1551
Loss = 3.9253e-04, PNorm = 110.7032, GNorm = 0.0131, lr_0 = 9.2289e-04
Loss = 6.1004e-04, PNorm = 110.7082, GNorm = 0.0228, lr_0 = 9.2287e-04
Validation auc = 0.717253
Epoch 1552
Validation auc = 0.718019
Epoch 1553
Validation auc = 0.716051
Epoch 1554
Validation auc = 0.714793
Epoch 1555
Validation auc = 0.714465
Epoch 1556
Loss = 4.1183e-04, PNorm = 110.7847, GNorm = 0.0150, lr_0 = 9.2264e-04
Loss = 1.1667e-03, PNorm = 110.7885, GNorm = 0.0362, lr_0 = 9.2263e-04
Validation auc = 0.714247
Epoch 1557
Validation auc = 0.713044
Epoch 1558
Validation auc = 0.712060
Epoch 1559
Validation auc = 0.711185
Epoch 1560
Validation auc = 0.710201
Epoch 1561
Loss = 1.0153e-03, PNorm = 110.8247, GNorm = 0.0247, lr_0 = 9.2242e-04
Validation auc = 0.709818
Epoch 1562
Validation auc = 0.709217
Epoch 1563
Validation auc = 0.709436
Epoch 1564
Validation auc = 0.709162
Epoch 1565
Validation auc = 0.712169
Epoch 1566
Loss = 2.5829e-04, PNorm = 110.8465, GNorm = 0.0065, lr_0 = 9.2217e-04
Validation auc = 0.715340
Epoch 1567
Validation auc = 0.716488
Epoch 1568
Validation auc = 0.717745
Epoch 1569
Validation auc = 0.716925
Epoch 1570
Loss = 8.3623e-04, PNorm = 110.8639, GNorm = 0.0356, lr_0 = 9.2196e-04
Loss = 2.1842e-04, PNorm = 110.8660, GNorm = 0.0083, lr_0 = 9.2194e-04
Validation auc = 0.716160
Epoch 1571
Validation auc = 0.714629
Epoch 1572
Validation auc = 0.708780
Epoch 1573
Validation auc = 0.704625
Epoch 1574
Validation auc = 0.701782
Epoch 1575
Loss = 7.4241e-04, PNorm = 110.9068, GNorm = 0.0516, lr_0 = 9.2173e-04
Validation auc = 0.699486
Epoch 1576
Validation auc = 0.696862
Epoch 1577
Validation auc = 0.695933
Epoch 1578
Validation auc = 0.695222
Epoch 1579
Validation auc = 0.694183
Epoch 1580
Loss = 3.1447e-03, PNorm = 110.9629, GNorm = 0.0826, lr_0 = 9.2148e-04
Validation auc = 0.694347
Epoch 1581
Validation auc = 0.690138
Epoch 1582
Validation auc = 0.683578
Epoch 1583
Validation auc = 0.678985
Epoch 1584
Loss = 4.4193e-02, PNorm = 111.0431, GNorm = 0.2874, lr_0 = 9.2127e-04
Loss = 5.0424e-03, PNorm = 111.0532, GNorm = 0.1865, lr_0 = 9.2125e-04
Validation auc = 0.677619
Epoch 1585
Validation auc = 0.678056
Epoch 1586
Validation auc = 0.678712
Epoch 1587
Validation auc = 0.678985
Epoch 1588
Validation auc = 0.681336
Epoch 1589
Loss = 7.8144e-04, PNorm = 111.1574, GNorm = 0.0169, lr_0 = 9.2103e-04
Loss = 6.3841e-03, PNorm = 111.1626, GNorm = 0.1136, lr_0 = 9.2101e-04
Validation auc = 0.682539
Epoch 1590
Validation auc = 0.683468
Epoch 1591
Validation auc = 0.684507
Epoch 1592
Validation auc = 0.684944
Epoch 1593
Validation auc = 0.684726
Epoch 1594
Loss = 1.4390e-03, PNorm = 111.2137, GNorm = 0.0483, lr_0 = 9.2080e-04
Validation auc = 0.684343
Epoch 1595
Validation auc = 0.684179
Epoch 1596
Validation auc = 0.685819
Epoch 1597
Validation auc = 0.690411
Epoch 1598
Validation auc = 0.694730
Epoch 1599
Loss = 2.9111e-03, PNorm = 111.2573, GNorm = 0.0884, lr_0 = 9.2055e-04
Validation auc = 0.696042
Epoch 1600
Validation auc = 0.696698
Epoch 1601
Validation auc = 0.695659
Epoch 1602
Validation auc = 0.694675
Epoch 1603
Loss = 8.9788e-04, PNorm = 111.2896, GNorm = 0.0163, lr_0 = 9.2034e-04
Loss = 3.0973e-04, PNorm = 111.2917, GNorm = 0.0098, lr_0 = 9.2032e-04
Validation auc = 0.693582
Epoch 1604
Validation auc = 0.693090
Epoch 1605
Validation auc = 0.692598
Epoch 1606
Validation auc = 0.692215
Epoch 1607
Validation auc = 0.691668
Epoch 1608
Loss = 6.6213e-05, PNorm = 111.3166, GNorm = 0.0019, lr_0 = 9.2010e-04
Validation auc = 0.690903
Epoch 1609
Validation auc = 0.691286
Epoch 1610
Validation auc = 0.691395
Epoch 1611
Validation auc = 0.690903
Epoch 1612
Validation auc = 0.690028
Epoch 1613
Loss = 1.2250e-04, PNorm = 111.3333, GNorm = 0.0027, lr_0 = 9.1987e-04
Validation auc = 0.689536
Epoch 1614
Validation auc = 0.688279
Epoch 1615
Validation auc = 0.687787
Epoch 1616
Validation auc = 0.687404
Epoch 1617
Loss = 1.7194e-03, PNorm = 111.3533, GNorm = 0.0241, lr_0 = 9.1966e-04
Loss = 3.3118e-05, PNorm = 111.3550, GNorm = 0.0018, lr_0 = 9.1964e-04
Validation auc = 0.686803
Epoch 1618
Validation auc = 0.688388
Epoch 1619
Validation auc = 0.690302
Epoch 1620
Validation auc = 0.691559
Epoch 1621
Validation auc = 0.693145
Epoch 1622
Loss = 2.3338e-03, PNorm = 111.3779, GNorm = 0.0480, lr_0 = 9.1941e-04
Loss = 7.1583e-03, PNorm = 111.3808, GNorm = 0.3192, lr_0 = 9.1939e-04
Validation auc = 0.693527
Epoch 1623
Validation auc = 0.694183
Epoch 1624
Validation auc = 0.693691
Epoch 1625
Validation auc = 0.694621
Epoch 1626
Validation auc = 0.694074
Epoch 1627
Loss = 5.4098e-04, PNorm = 111.4160, GNorm = 0.0106, lr_0 = 9.1918e-04
Validation auc = 0.694129
Epoch 1628
Validation auc = 0.693910
Epoch 1629
Validation auc = 0.694019
Epoch 1630
Validation auc = 0.693746
Epoch 1631
Validation auc = 0.693637
Epoch 1632
Loss = 4.9459e-05, PNorm = 111.4397, GNorm = 0.0013, lr_0 = 9.1894e-04
Validation auc = 0.693254
Epoch 1633
Validation auc = 0.693090
Epoch 1634
Validation auc = 0.692707
Epoch 1635
Validation auc = 0.692270
Epoch 1636
Loss = 3.8911e-04, PNorm = 111.4544, GNorm = 0.0027, lr_0 = 9.1873e-04
Loss = 1.6093e-06, PNorm = 111.4552, GNorm = 0.0001, lr_0 = 9.1871e-04
Validation auc = 0.691997
Epoch 1637
Validation auc = 0.691614
Epoch 1638
Validation auc = 0.691997
Epoch 1639
Validation auc = 0.693801
Epoch 1640
Validation auc = 0.696097
Epoch 1641
Loss = 9.0955e-04, PNorm = 111.4660, GNorm = 0.0278, lr_0 = 9.1848e-04
Validation auc = 0.697245
Epoch 1642
Validation auc = 0.697901
Epoch 1643
Validation auc = 0.699595
Epoch 1644
Validation auc = 0.699814
Epoch 1645
Validation auc = 0.698447
Epoch 1646
Loss = 5.0134e-05, PNorm = 111.4748, GNorm = 0.0016, lr_0 = 9.1825e-04
Validation auc = 0.697463
Epoch 1647
Validation auc = 0.696862
Epoch 1648
Validation auc = 0.696206
Epoch 1649
Validation auc = 0.695769
Epoch 1650
Loss = 7.2083e-04, PNorm = 111.4838, GNorm = 0.0142, lr_0 = 9.1804e-04
Loss = 1.0053e-05, PNorm = 111.4845, GNorm = 0.0005, lr_0 = 9.1803e-04
Validation auc = 0.695331
Epoch 1651
Validation auc = 0.695113
Epoch 1652
Validation auc = 0.695058
Epoch 1653
Validation auc = 0.694949
Epoch 1654
Validation auc = 0.694785
Epoch 1655
Loss = 5.0055e-04, PNorm = 111.4919, GNorm = 0.0217, lr_0 = 9.1780e-04
Loss = 1.3768e-05, PNorm = 111.4924, GNorm = 0.0009, lr_0 = 9.1778e-04
Validation auc = 0.694566
Epoch 1656
Validation auc = 0.694457
Epoch 1657
Validation auc = 0.694457
Epoch 1658
Validation auc = 0.694238
Epoch 1659
Validation auc = 0.694019
Epoch 1660
Loss = 2.1079e-05, PNorm = 111.4973, GNorm = 0.0007, lr_0 = 9.1757e-04
Validation auc = 0.693965
Epoch 1661
Validation auc = 0.693910
Epoch 1662
Validation auc = 0.693965
Epoch 1663
Validation auc = 0.693855
Epoch 1664
Validation auc = 0.693965
Epoch 1665
Loss = 5.4477e-05, PNorm = 111.5011, GNorm = 0.0019, lr_0 = 9.1733e-04
Validation auc = 0.694293
Epoch 1666
Validation auc = 0.695331
Epoch 1667
Validation auc = 0.695441
Epoch 1668
Validation auc = 0.695659
Epoch 1669
Loss = 3.5053e-04, PNorm = 111.5057, GNorm = 0.0338, lr_0 = 9.1712e-04
Loss = 6.3313e-05, PNorm = 111.5062, GNorm = 0.0019, lr_0 = 9.1710e-04
Validation auc = 0.695769
Epoch 1670
Validation auc = 0.695714
Epoch 1671
Validation auc = 0.695714
Epoch 1672
Validation auc = 0.695769
Epoch 1673
Validation auc = 0.695659
Epoch 1674
Loss = 1.1281e-03, PNorm = 111.5111, GNorm = 0.0984, lr_0 = 9.1687e-04
Validation auc = 0.695331
Epoch 1675
Validation auc = 0.695441
Epoch 1676
Validation auc = 0.695386
Epoch 1677
Validation auc = 0.695113
Epoch 1678
Validation auc = 0.694402
Epoch 1679
Loss = 2.3625e-04, PNorm = 111.5204, GNorm = 0.0072, lr_0 = 9.1664e-04
Validation auc = 0.693746
Epoch 1680
Validation auc = 0.692653
Epoch 1681
Validation auc = 0.692707
Epoch 1682
Validation auc = 0.692653
Epoch 1683
Loss = 7.2454e-05, PNorm = 111.5323, GNorm = 0.0005, lr_0 = 9.1642e-04
Validation auc = 0.693145
Epoch 1684
Validation auc = 0.693090
Epoch 1685
Validation auc = 0.692871
Epoch 1686
Validation auc = 0.693090
Epoch 1687
Validation auc = 0.693473
Epoch 1688
Loss = 9.7106e-03, PNorm = 111.5451, GNorm = 0.6125, lr_0 = 9.1619e-04
Loss = 1.7484e-06, PNorm = 111.5448, GNorm = 0.0001, lr_0 = 9.1617e-04
Validation auc = 0.695605
Epoch 1689
Validation auc = 0.697081
Epoch 1690
Validation auc = 0.697299
Epoch 1691
Validation auc = 0.697901
Epoch 1692
Validation auc = 0.697518
Epoch 1693
Loss = 1.8453e-05, PNorm = 111.5494, GNorm = 0.0005, lr_0 = 9.1596e-04
Validation auc = 0.697518
Epoch 1694
Validation auc = 0.697190
Epoch 1695
Validation auc = 0.697409
Epoch 1696
Validation auc = 0.697573
Epoch 1697
Validation auc = 0.697354
Epoch 1698
Loss = 9.2273e-05, PNorm = 111.5540, GNorm = 0.0024, lr_0 = 9.1572e-04
Validation auc = 0.697463
Epoch 1699
Validation auc = 0.697190
Epoch 1700
Validation auc = 0.697081
Epoch 1701
Validation auc = 0.697135
Epoch 1702
Loss = 5.4371e-05, PNorm = 111.5573, GNorm = 0.0003, lr_0 = 9.1551e-04
Loss = 1.4543e-05, PNorm = 111.5576, GNorm = 0.0005, lr_0 = 9.1549e-04
Validation auc = 0.697354
Epoch 1703
Validation auc = 0.697354
Epoch 1704
Validation auc = 0.697245
Epoch 1705
Validation auc = 0.697190
Epoch 1706
Validation auc = 0.696807
Epoch 1707
Loss = 4.6514e-05, PNorm = 111.5627, GNorm = 0.0010, lr_0 = 9.1526e-04
Loss = 1.6689e-06, PNorm = 111.5632, GNorm = 0.0002, lr_0 = 9.1525e-04
Validation auc = 0.696807
Epoch 1708
Validation auc = 0.696479
Epoch 1709
Validation auc = 0.696589
Epoch 1710
Validation auc = 0.696425
Epoch 1711
Validation auc = 0.696261
Epoch 1712
Loss = 1.9573e-05, PNorm = 111.5669, GNorm = 0.0006, lr_0 = 9.1504e-04
Validation auc = 0.696151
Epoch 1713
Validation auc = 0.696097
Epoch 1714
Validation auc = 0.696097
Epoch 1715
Validation auc = 0.696042
Epoch 1716
Loss = 4.3793e-05, PNorm = 111.5699, GNorm = 0.0004, lr_0 = 9.1481e-04
Validation auc = 0.696151
Epoch 1717
Validation auc = 0.696151
Epoch 1718
Validation auc = 0.696097
Epoch 1719
Validation auc = 0.696097
Epoch 1720
Validation auc = 0.696042
Epoch 1721
Loss = 7.3259e-05, PNorm = 111.5733, GNorm = 0.0010, lr_0 = 9.1458e-04
Loss = 4.9273e-06, PNorm = 111.5737, GNorm = 0.0003, lr_0 = 9.1457e-04
Validation auc = 0.696206
Epoch 1722
Validation auc = 0.696206
Epoch 1723
Validation auc = 0.696315
Epoch 1724
Validation auc = 0.696534
Epoch 1725
Validation auc = 0.696315
Epoch 1726
Loss = 1.5173e-05, PNorm = 111.5770, GNorm = 0.0005, lr_0 = 9.1436e-04
Validation auc = 0.696315
Epoch 1727
Validation auc = 0.696315
Epoch 1728
Validation auc = 0.696206
Epoch 1729
Validation auc = 0.696206
Epoch 1730
Validation auc = 0.696151
Epoch 1731
Loss = 5.0071e-05, PNorm = 111.5793, GNorm = 0.0019, lr_0 = 9.1411e-04
Validation auc = 0.696151
Epoch 1732
Validation auc = 0.696097
Epoch 1733
Validation auc = 0.695441
Epoch 1734
Validation auc = 0.695550
Epoch 1735
Loss = 4.4323e-05, PNorm = 111.5828, GNorm = 0.0004, lr_0 = 9.1390e-04
Loss = 1.5477e-05, PNorm = 111.5831, GNorm = 0.0006, lr_0 = 9.1389e-04
Validation auc = 0.695331
Epoch 1736
Validation auc = 0.695277
Epoch 1737
Validation auc = 0.695222
Epoch 1738
Validation auc = 0.695058
Epoch 1739
Validation auc = 0.696534
Epoch 1740
Loss = 6.7732e-05, PNorm = 111.5917, GNorm = 0.0025, lr_0 = 9.1366e-04
Loss = 1.4324e-05, PNorm = 111.5932, GNorm = 0.0005, lr_0 = 9.1364e-04
Validation auc = 0.697026
Epoch 1741
Validation auc = 0.696753
Epoch 1742
Validation auc = 0.697791
Epoch 1743
Validation auc = 0.697190
Epoch 1744
Validation auc = 0.697081
Epoch 1745
Loss = 8.7973e-06, PNorm = 111.6014, GNorm = 0.0002, lr_0 = 9.1343e-04
Validation auc = 0.697026
Epoch 1746
Validation auc = 0.697135
Epoch 1747
Validation auc = 0.696479
Epoch 1748
Validation auc = 0.695823
Epoch 1749
Loss = 3.8255e-05, PNorm = 111.6274, GNorm = 0.0011, lr_0 = 9.1320e-04
Validation auc = 0.696370
Epoch 1750
Validation auc = 0.695823
Epoch 1751
Validation auc = 0.695277
Epoch 1752
Validation auc = 0.695058
Epoch 1753
Validation auc = 0.694785
Epoch 1754
Loss = 7.7911e-03, PNorm = 111.6409, GNorm = 0.0015, lr_0 = 9.1298e-04
Loss = 2.3390e-04, PNorm = 111.6419, GNorm = 0.0081, lr_0 = 9.1296e-04
Validation auc = 0.695331
Epoch 1755
Validation auc = 0.695495
Epoch 1756
Validation auc = 0.697627
Epoch 1757
Validation auc = 0.699213
Epoch 1758
Validation auc = 0.700087
Epoch 1759
Loss = 1.4073e-04, PNorm = 111.6618, GNorm = 0.0046, lr_0 = 9.1275e-04
Validation auc = 0.701892
Epoch 1760
Validation auc = 0.701400
Epoch 1761
Validation auc = 0.701072
Epoch 1762
Validation auc = 0.701181
Epoch 1763
Validation auc = 0.701454
Epoch 1764
Loss = 3.2580e-03, PNorm = 111.6800, GNorm = 0.1611, lr_0 = 9.1251e-04
Validation auc = 0.701782
Epoch 1765
Validation auc = 0.702056
Epoch 1766
Validation auc = 0.701946
Epoch 1767
Validation auc = 0.700853
Epoch 1768
Loss = 2.7987e-04, PNorm = 111.6941, GNorm = 0.0071, lr_0 = 9.1230e-04
Loss = 3.1076e-03, PNorm = 111.6955, GNorm = 0.3571, lr_0 = 9.1228e-04
Validation auc = 0.700361
Epoch 1769
Validation auc = 0.699103
Epoch 1770
Validation auc = 0.698557
Epoch 1771
Validation auc = 0.697791
Epoch 1772
Validation auc = 0.699377
Epoch 1773
Loss = 1.2930e-03, PNorm = 111.6917, GNorm = 0.0182, lr_0 = 9.1206e-04
Loss = 2.1393e-03, PNorm = 111.6903, GNorm = 0.1350, lr_0 = 9.1204e-04
Validation auc = 0.698994
Epoch 1774
Validation auc = 0.699213
Epoch 1775
Validation auc = 0.699650
Epoch 1776
Validation auc = 0.699377
Epoch 1777
Validation auc = 0.698939
Epoch 1778
Loss = 4.1022e-03, PNorm = 111.6911, GNorm = 0.1181, lr_0 = 9.1183e-04
Validation auc = 0.699103
Epoch 1779
Validation auc = 0.698447
Epoch 1780
Validation auc = 0.698393
Epoch 1781
Validation auc = 0.698010
Epoch 1782
Validation auc = 0.697354
Epoch 1783
Loss = 1.2480e-04, PNorm = 111.7174, GNorm = 0.0055, lr_0 = 9.1159e-04
Validation auc = 0.696534
Epoch 1784
Validation auc = 0.695987
Epoch 1785
Validation auc = 0.695714
Epoch 1786
Validation auc = 0.695659
Epoch 1787
Loss = 6.4939e-04, PNorm = 111.7352, GNorm = 0.0073, lr_0 = 9.1138e-04
Loss = 2.7774e-05, PNorm = 111.7362, GNorm = 0.0022, lr_0 = 9.1136e-04
Validation auc = 0.695058
Epoch 1788
Validation auc = 0.694402
Epoch 1789
Validation auc = 0.693473
Epoch 1790
Validation auc = 0.693473
Epoch 1791
Validation auc = 0.693199
Epoch 1792
Loss = 6.9683e-05, PNorm = 111.7460, GNorm = 0.0021, lr_0 = 9.1115e-04
Validation auc = 0.693363
Epoch 1793
Validation auc = 0.693309
Epoch 1794
Validation auc = 0.693145
Epoch 1795
Validation auc = 0.693090
Epoch 1796
Validation auc = 0.693035
Epoch 1797
Loss = 5.1646e-05, PNorm = 111.7505, GNorm = 0.0015, lr_0 = 9.1091e-04
Validation auc = 0.693035
Epoch 1798
Validation auc = 0.693035
Epoch 1799
Validation auc = 0.692871
Epoch 1800
Validation auc = 0.693527
Epoch 1801
Loss = 1.3957e-04, PNorm = 111.7528, GNorm = 0.0058, lr_0 = 9.1070e-04
Loss = 1.9073e-06, PNorm = 111.7530, GNorm = 0.0001, lr_0 = 9.1068e-04
Validation auc = 0.693527
Epoch 1802
Validation auc = 0.693473
Epoch 1803
Validation auc = 0.693473
Epoch 1804
Validation auc = 0.693691
Epoch 1805
Validation auc = 0.693637
Epoch 1806
Loss = 3.8004e-05, PNorm = 111.7556, GNorm = 0.0033, lr_0 = 9.1046e-04
Loss = 3.8204e-05, PNorm = 111.7557, GNorm = 0.0013, lr_0 = 9.1044e-04
Validation auc = 0.693637
Epoch 1807
Validation auc = 0.693691
Epoch 1808
Validation auc = 0.693691
Epoch 1809
Validation auc = 0.693691
Epoch 1810
Validation auc = 0.693637
Epoch 1811
Loss = 1.6214e-05, PNorm = 111.7570, GNorm = 0.0005, lr_0 = 9.1023e-04
Validation auc = 0.693637
Epoch 1812
Validation auc = 0.693637
Epoch 1813
Validation auc = 0.693582
Epoch 1814
Validation auc = 0.693473
Epoch 1815
Validation auc = 0.693473
Epoch 1816
Loss = 5.2188e-06, PNorm = 111.7581, GNorm = 0.0002, lr_0 = 9.0999e-04
Validation auc = 0.693473
Epoch 1817
Validation auc = 0.693418
Epoch 1818
Validation auc = 0.693418
Epoch 1819
Validation auc = 0.693418
Epoch 1820
Loss = 3.6203e-05, PNorm = 111.7592, GNorm = 0.0007, lr_0 = 9.0978e-04
Loss = 3.9736e-07, PNorm = 111.7593, GNorm = 0.0000, lr_0 = 9.0976e-04
Validation auc = 0.693363
Epoch 1821
Validation auc = 0.693363
Epoch 1822
Validation auc = 0.693309
Epoch 1823
Validation auc = 0.693254
Epoch 1824
Validation auc = 0.693309
Epoch 1825
Loss = 1.0280e-05, PNorm = 111.7605, GNorm = 0.0003, lr_0 = 9.0955e-04
Validation auc = 0.693309
Epoch 1826
Validation auc = 0.693363
Epoch 1827
Validation auc = 0.691997
Epoch 1828
Validation auc = 0.689919
Epoch 1829
Validation auc = 0.688334
Epoch 1830
Loss = 1.8875e-05, PNorm = 111.7677, GNorm = 0.0008, lr_0 = 9.0931e-04
Validation auc = 0.687240
Epoch 1831
Validation auc = 0.686858
Epoch 1832
Validation auc = 0.685983
Epoch 1833
Validation auc = 0.686092
Epoch 1834
Loss = 3.8850e-04, PNorm = 111.7735, GNorm = 0.0750, lr_0 = 9.0910e-04
Loss = 7.3114e-06, PNorm = 111.7738, GNorm = 0.0005, lr_0 = 9.0909e-04
Validation auc = 0.686420
Epoch 1835
Validation auc = 0.686803
Epoch 1836
Validation auc = 0.686694
Epoch 1837
Validation auc = 0.686639
Epoch 1838
Validation auc = 0.686748
Epoch 1839
Loss = 1.1278e-05, PNorm = 111.7764, GNorm = 0.0002, lr_0 = 9.0886e-04
Loss = 2.5829e-07, PNorm = 111.7765, GNorm = 0.0000, lr_0 = 9.0884e-04
Validation auc = 0.686584
Epoch 1840
Validation auc = 0.686748
Epoch 1841
Validation auc = 0.686803
Epoch 1842
Validation auc = 0.686748
Epoch 1843
Validation auc = 0.686858
Epoch 1844
Loss = 1.9105e-05, PNorm = 111.7776, GNorm = 0.0010, lr_0 = 9.0863e-04
Validation auc = 0.686748
Epoch 1845
Validation auc = 0.686858
Epoch 1846
Validation auc = 0.686858
Epoch 1847
Validation auc = 0.686858
Epoch 1848
Validation auc = 0.686748
Epoch 1849
Loss = 6.7279e-06, PNorm = 111.7787, GNorm = 0.0003, lr_0 = 9.0839e-04
Validation auc = 0.686639
Epoch 1850
Validation auc = 0.686694
Epoch 1851
Validation auc = 0.686639
Epoch 1852
Validation auc = 0.686748
Epoch 1853
Loss = 1.2499e-05, PNorm = 111.7805, GNorm = 0.0005, lr_0 = 9.0818e-04
Loss = 1.5854e-05, PNorm = 111.7806, GNorm = 0.0011, lr_0 = 9.0817e-04
Validation auc = 0.686803
Epoch 1854
Validation auc = 0.686748
Epoch 1855
Validation auc = 0.686912
Epoch 1856
Validation auc = 0.687076
Epoch 1857
Validation auc = 0.687186
Epoch 1858
Loss = 2.5232e-05, PNorm = 111.7822, GNorm = 0.0004, lr_0 = 9.0794e-04
Validation auc = 0.687186
Epoch 1859
Validation auc = 0.687295
Epoch 1860
Validation auc = 0.687295
Epoch 1861
Validation auc = 0.687295
Epoch 1862
Validation auc = 0.687295
Epoch 1863
Loss = 2.6354e-05, PNorm = 111.7832, GNorm = 0.0009, lr_0 = 9.0772e-04
Validation auc = 0.687295
Epoch 1864
Validation auc = 0.687295
Epoch 1865
Validation auc = 0.687295
Epoch 1866
Validation auc = 0.687295
Epoch 1867
Loss = 8.8131e-06, PNorm = 111.7842, GNorm = 0.0012, lr_0 = 9.0751e-04
Loss = 9.9341e-08, PNorm = 111.7843, GNorm = 0.0000, lr_0 = 9.0749e-04
Validation auc = 0.687186
Epoch 1868
Validation auc = 0.687240
Epoch 1869
Validation auc = 0.687240
Epoch 1870
Validation auc = 0.687186
Epoch 1871
Validation auc = 0.687186
Epoch 1872
Loss = 1.0103e-05, PNorm = 111.7851, GNorm = 0.0005, lr_0 = 9.0727e-04
Loss = 1.1921e-07, PNorm = 111.7851, GNorm = 0.0000, lr_0 = 9.0725e-04
Validation auc = 0.687186
Epoch 1873
Validation auc = 0.687240
Epoch 1874
Validation auc = 0.687186
Epoch 1875
Validation auc = 0.687131
Epoch 1876
Validation auc = 0.687186
Epoch 1877
Loss = 6.5510e-06, PNorm = 111.7857, GNorm = 0.0004, lr_0 = 9.0704e-04
Validation auc = 0.687186
Epoch 1878
Validation auc = 0.687186
Epoch 1879
Validation auc = 0.687076
Epoch 1880
Validation auc = 0.687076
Epoch 1881
Validation auc = 0.687131
Epoch 1882
Loss = 1.1610e-05, PNorm = 111.7866, GNorm = 0.0004, lr_0 = 9.0680e-04
Validation auc = 0.687131
Epoch 1883
Validation auc = 0.687022
Epoch 1884
Validation auc = 0.687022
Epoch 1885
Validation auc = 0.687022
Epoch 1886
Loss = 1.8690e-05, PNorm = 111.7873, GNorm = 0.0000, lr_0 = 9.0659e-04
Loss = 1.8377e-05, PNorm = 111.7874, GNorm = 0.0010, lr_0 = 9.0657e-04
Validation auc = 0.687022
Epoch 1887
Validation auc = 0.686967
Epoch 1888
Validation auc = 0.686967
Epoch 1889
Validation auc = 0.687022
Epoch 1890
Validation auc = 0.687022
Epoch 1891
Loss = 2.2733e-06, PNorm = 111.7881, GNorm = 0.0001, lr_0 = 9.0635e-04
Validation auc = 0.687022
Epoch 1892
Validation auc = 0.687022
Epoch 1893
Validation auc = 0.687022
Epoch 1894
Validation auc = 0.687022
Epoch 1895
Validation auc = 0.687022
Epoch 1896
Loss = 6.5540e-06, PNorm = 111.7889, GNorm = 0.0002, lr_0 = 9.0612e-04
Validation auc = 0.686967
Epoch 1897
Validation auc = 0.686967
Epoch 1898
Validation auc = 0.686912
Epoch 1899
Validation auc = 0.686912
Epoch 1900
Loss = 6.4011e-06, PNorm = 111.7897, GNorm = 0.0002, lr_0 = 9.0592e-04
Loss = 7.9868e-06, PNorm = 111.7897, GNorm = 0.0005, lr_0 = 9.0590e-04
Validation auc = 0.686912
Epoch 1901
Validation auc = 0.686912
Epoch 1902
Validation auc = 0.686912
Epoch 1903
Validation auc = 0.686912
Epoch 1904
Validation auc = 0.686858
Epoch 1905
Loss = 8.3466e-06, PNorm = 111.7906, GNorm = 0.0006, lr_0 = 9.0567e-04
Loss = 4.0332e-06, PNorm = 111.7906, GNorm = 0.0002, lr_0 = 9.0566e-04
Validation auc = 0.686912
Epoch 1906
Validation auc = 0.686912
Epoch 1907
Validation auc = 0.686912
Epoch 1908
Validation auc = 0.686912
Epoch 1909
Validation auc = 0.686858
Epoch 1910
Loss = 4.2533e-06, PNorm = 111.7916, GNorm = 0.0002, lr_0 = 9.0545e-04
Validation auc = 0.686967
Epoch 1911
Validation auc = 0.686803
Epoch 1912
Validation auc = 0.686475
Epoch 1913
Validation auc = 0.686366
Epoch 1914
Validation auc = 0.686475
Epoch 1915
Loss = 4.9766e-04, PNorm = 111.8065, GNorm = 0.0696, lr_0 = 9.0521e-04
Validation auc = 0.686803
Epoch 1916
Validation auc = 0.686694
Epoch 1917
Validation auc = 0.686748
Epoch 1918
Validation auc = 0.686858
Epoch 1919
Loss = 9.6738e-05, PNorm = 111.8133, GNorm = 0.0168, lr_0 = 9.0500e-04
Loss = 1.8875e-06, PNorm = 111.8137, GNorm = 0.0001, lr_0 = 9.0498e-04
Validation auc = 0.686912
Epoch 1920
Validation auc = 0.686748
Epoch 1921
Validation auc = 0.686967
Epoch 1922
Validation auc = 0.686748
Epoch 1923
Validation auc = 0.685327
Epoch 1924
Loss = 1.2782e-05, PNorm = 111.8232, GNorm = 0.0010, lr_0 = 9.0476e-04
Validation auc = 0.684890
Epoch 1925
Validation auc = 0.684780
Epoch 1926
Validation auc = 0.684507
Epoch 1927
Validation auc = 0.684452
Epoch 1928
Validation auc = 0.684398
Epoch 1929
Loss = 3.0373e-06, PNorm = 111.8327, GNorm = 0.0001, lr_0 = 9.0454e-04
Validation auc = 0.684398
Epoch 1930
Validation auc = 0.684015
Epoch 1931
Validation auc = 0.683906
Epoch 1932
Validation auc = 0.683742
Epoch 1933
Loss = 4.6972e-06, PNorm = 111.8356, GNorm = 0.0006, lr_0 = 9.0431e-04
Validation auc = 0.683632
Epoch 1934
Validation auc = 0.683687
Epoch 1935
Validation auc = 0.683687
Epoch 1936
Validation auc = 0.683687
Epoch 1937
Validation auc = 0.683687
Epoch 1938
Loss = 1.0623e-05, PNorm = 111.8365, GNorm = 0.0013, lr_0 = 9.0409e-04
Loss = 0.0000e+00, PNorm = 111.8365, GNorm = 0.0000, lr_0 = 9.0407e-04
Validation auc = 0.683632
Epoch 1939
Validation auc = 0.683632
Epoch 1940
Validation auc = 0.683632
Epoch 1941
Validation auc = 0.683632
Epoch 1942
Validation auc = 0.683632
Epoch 1943
Loss = 8.2770e-06, PNorm = 111.8376, GNorm = 0.0003, lr_0 = 9.0386e-04
Validation auc = 0.683632
Epoch 1944
Validation auc = 0.683578
Epoch 1945
Validation auc = 0.683523
Epoch 1946
Validation auc = 0.683523
Epoch 1947
Validation auc = 0.683468
Epoch 1948
Loss = 9.4889e-07, PNorm = 111.8388, GNorm = 0.0000, lr_0 = 9.0362e-04
Validation auc = 0.683468
Epoch 1949
Validation auc = 0.683468
Epoch 1950
Validation auc = 0.683414
Epoch 1951
Validation auc = 0.683414
Epoch 1952
Loss = 9.5486e-07, PNorm = 111.8396, GNorm = 0.0000, lr_0 = 9.0341e-04
Loss = 5.9605e-08, PNorm = 111.8397, GNorm = 0.0000, lr_0 = 9.0340e-04
Validation auc = 0.683359
Epoch 1953
Validation auc = 0.683414
Epoch 1954
Validation auc = 0.683468
Epoch 1955
Validation auc = 0.683468
Epoch 1956
Validation auc = 0.683523
Epoch 1957
Loss = 1.8465e-06, PNorm = 111.8403, GNorm = 0.0001, lr_0 = 9.0317e-04
Loss = 9.7153e-06, PNorm = 111.8403, GNorm = 0.0009, lr_0 = 9.0316e-04
Validation auc = 0.683523
Epoch 1958
Validation auc = 0.683578
Epoch 1959
Validation auc = 0.683578
Epoch 1960
Validation auc = 0.683578
Epoch 1961
Validation auc = 0.683632
Epoch 1962
Loss = 3.9816e-07, PNorm = 111.8407, GNorm = 0.0000, lr_0 = 9.0295e-04
Validation auc = 0.683632
Epoch 1963
Validation auc = 0.683632
Epoch 1964
Validation auc = 0.683796
Epoch 1965
Validation auc = 0.684452
Epoch 1966
Loss = 7.7803e-07, PNorm = 111.8491, GNorm = 0.0000, lr_0 = 9.0273e-04
Validation auc = 0.685108
Epoch 1967
Validation auc = 0.685600
Epoch 1968
Validation auc = 0.685874
Epoch 1969
Validation auc = 0.685928
Epoch 1970
Validation auc = 0.686202
Epoch 1971
Loss = 4.5009e-06, PNorm = 111.8594, GNorm = 0.0003, lr_0 = 9.0250e-04
Loss = 5.7618e-07, PNorm = 111.8598, GNorm = 0.0000, lr_0 = 9.0249e-04
Validation auc = 0.686420
Epoch 1972
Validation auc = 0.686420
Epoch 1973
Validation auc = 0.686420
Epoch 1974
Validation auc = 0.686420
Epoch 1975
Validation auc = 0.686530
Epoch 1976
Loss = 4.7752e-06, PNorm = 111.8626, GNorm = 0.0002, lr_0 = 9.0228e-04
Validation auc = 0.686530
Epoch 1977
Validation auc = 0.686530
Epoch 1978
Validation auc = 0.686475
Epoch 1979
Validation auc = 0.686420
Epoch 1980
Validation auc = 0.686420
Epoch 1981
Loss = 4.2677e-07, PNorm = 111.8643, GNorm = 0.0000, lr_0 = 9.0204e-04
Validation auc = 0.686420
Epoch 1982
Validation auc = 0.686420
Epoch 1983
Validation auc = 0.686420
Epoch 1984
Validation auc = 0.686420
Epoch 1985
Loss = 6.3236e-06, PNorm = 111.8657, GNorm = 0.0006, lr_0 = 9.0183e-04
Loss = 2.9802e-07, PNorm = 111.8658, GNorm = 0.0000, lr_0 = 9.0181e-04
Validation auc = 0.686420
Epoch 1986
Validation auc = 0.686366
Epoch 1987
Validation auc = 0.686420
Epoch 1988
Validation auc = 0.686311
Epoch 1989
Validation auc = 0.686311
Epoch 1990
Loss = 1.4948e-06, PNorm = 111.8671, GNorm = 0.0001, lr_0 = 9.0159e-04
Loss = 1.0729e-06, PNorm = 111.8671, GNorm = 0.0000, lr_0 = 9.0157e-04
Validation auc = 0.686366
Epoch 1991
Validation auc = 0.686366
Epoch 1992
Validation auc = 0.686366
Epoch 1993
Validation auc = 0.686366
Epoch 1994
Validation auc = 0.686366
Epoch 1995
Loss = 8.1008e-06, PNorm = 111.8677, GNorm = 0.0003, lr_0 = 9.0137e-04
Validation auc = 0.686366
Epoch 1996
Validation auc = 0.686366
Epoch 1997
Validation auc = 0.686311
Epoch 1998
Validation auc = 0.686311
Epoch 1999
Loss = 9.1562e-06, PNorm = 111.8681, GNorm = 0.0014, lr_0 = 9.0114e-04
Validation auc = 0.686256
Model 0 best validation auc = 0.779630 on epoch 936
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.644667
Ensemble test auc = 0.644667
Fold 2
Splitting data with seed 2
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.593483
Epoch 1
Validation auc = 0.697791
Epoch 2
Validation auc = 0.581292
Epoch 3
Validation auc = 0.581347
Epoch 4
Loss = 6.9665e-01, PNorm = 71.6145, GNorm = 0.9151, lr_0 = 2.0385e-04
Loss = 6.7314e-01, PNorm = 71.6159, GNorm = 3.0185, lr_0 = 2.1077e-04
Validation auc = 0.634485
Epoch 5
Validation auc = 0.687459
Epoch 6
Validation auc = 0.673792
Epoch 7
Validation auc = 0.725563
Epoch 8
Validation auc = 0.693473
Epoch 9
Loss = 7.0331e-01, PNorm = 71.6394, GNorm = 2.3562, lr_0 = 3.0077e-04
Validation auc = 0.711896
Epoch 10
Validation auc = 0.658430
Epoch 11
Validation auc = 0.635524
Epoch 12
Validation auc = 0.621747
Epoch 13
Validation auc = 0.577794
Epoch 14
Loss = 6.6796e-01, PNorm = 71.6776, GNorm = 0.8048, lr_0 = 4.0462e-04
Validation auc = 0.545976
Epoch 15
Validation auc = 0.557019
Epoch 16
Validation auc = 0.554723
Epoch 17
Validation auc = 0.577356
Epoch 18
Loss = 6.9136e-01, PNorm = 71.7284, GNorm = 1.7707, lr_0 = 4.9462e-04
Loss = 6.9661e-01, PNorm = 71.7329, GNorm = 1.5500, lr_0 = 5.0154e-04
Validation auc = 0.604417
Epoch 19
Validation auc = 0.600536
Epoch 20
Validation auc = 0.589985
Epoch 21
Validation auc = 0.589711
Epoch 22
Validation auc = 0.587470
Epoch 23
Loss = 6.6953e-01, PNorm = 71.8081, GNorm = 0.4815, lr_0 = 5.9846e-04
Loss = 5.6623e-01, PNorm = 71.8156, GNorm = 1.6056, lr_0 = 6.0538e-04
Validation auc = 0.538760
Epoch 24
Validation auc = 0.497704
Epoch 25
Validation auc = 0.539799
Epoch 26
Validation auc = 0.578668
Epoch 27
Validation auc = 0.588235
Epoch 28
Loss = 6.7787e-01, PNorm = 71.8966, GNorm = 0.5586, lr_0 = 6.9538e-04
Validation auc = 0.576208
Epoch 29
Validation auc = 0.585502
Epoch 30
Validation auc = 0.586049
Epoch 31
Validation auc = 0.579324
Epoch 32
Validation auc = 0.592827
Epoch 33
Loss = 6.3264e-01, PNorm = 72.0273, GNorm = 0.3392, lr_0 = 7.9923e-04
Validation auc = 0.592663
Epoch 34
Validation auc = 0.550295
Epoch 35
Validation auc = 0.593921
Epoch 36
Validation auc = 0.577083
Epoch 37
Loss = 6.1831e-01, PNorm = 72.1414, GNorm = 0.5683, lr_0 = 8.8923e-04
Loss = 4.9301e-01, PNorm = 72.1524, GNorm = 1.0059, lr_0 = 8.9615e-04
Validation auc = 0.573311
Epoch 38
Validation auc = 0.549694
Epoch 39
Validation auc = 0.573037
Epoch 40
Validation auc = 0.597365
Epoch 41
Validation auc = 0.610376
Epoch 42
Loss = 6.5396e-01, PNorm = 72.3209, GNorm = 1.8315, lr_0 = 9.8615e-04
Validation auc = 0.592609
Epoch 43
Validation auc = 0.570741
Epoch 44
Validation auc = 0.559097
Epoch 45
Validation auc = 0.568555
Epoch 46
Validation auc = 0.561065
Epoch 47
Loss = 5.9857e-01, PNorm = 72.5457, GNorm = 0.6271, lr_0 = 9.9977e-04
Validation auc = 0.578122
Epoch 48
Validation auc = 0.593429
Epoch 49
Validation auc = 0.587415
Epoch 50
Validation auc = 0.603379
Epoch 51
Loss = 6.4761e-01, PNorm = 72.7471, GNorm = 1.0427, lr_0 = 9.9954e-04
Loss = 2.5994e-01, PNorm = 72.7633, GNorm = 0.8283, lr_0 = 9.9952e-04
Validation auc = 0.591570
Epoch 52
Validation auc = 0.581566
Epoch 53
Validation auc = 0.587634
Epoch 54
Validation auc = 0.580527
Epoch 55
Validation auc = 0.548600
Epoch 56
Loss = 5.7831e-01, PNorm = 72.9604, GNorm = 1.0262, lr_0 = 9.9927e-04
Loss = 5.2007e-01, PNorm = 72.9787, GNorm = 2.7610, lr_0 = 9.9926e-04
Validation auc = 0.588345
Epoch 57
Validation auc = 0.613274
Epoch 58
Validation auc = 0.633993
Epoch 59
Validation auc = 0.651378
Epoch 60
Validation auc = 0.648098
Epoch 61
Loss = 5.4011e-01, PNorm = 73.1969, GNorm = 0.7709, lr_0 = 9.9903e-04
Validation auc = 0.634430
Epoch 62
Validation auc = 0.610595
Epoch 63
Validation auc = 0.630768
Epoch 64
Validation auc = 0.607588
Epoch 65
Validation auc = 0.605401
Epoch 66
Loss = 6.4999e-01, PNorm = 73.4210, GNorm = 0.2447, lr_0 = 9.9876e-04
Validation auc = 0.604800
Epoch 67
Validation auc = 0.619888
Epoch 68
Validation auc = 0.613711
Epoch 69
Validation auc = 0.601793
Epoch 70
Loss = 5.5968e-01, PNorm = 73.6348, GNorm = 0.7037, lr_0 = 9.9853e-04
Loss = 6.2586e-01, PNorm = 73.6505, GNorm = 2.4727, lr_0 = 9.9851e-04
Validation auc = 0.623715
Epoch 71
Validation auc = 0.632244
Epoch 72
Validation auc = 0.633173
Epoch 73
Validation auc = 0.637218
Epoch 74
Validation auc = 0.630604
Epoch 75
Loss = 6.3457e-01, PNorm = 73.9074, GNorm = 5.7224, lr_0 = 9.9828e-04
Validation auc = 0.623223
Epoch 76
Validation auc = 0.617811
Epoch 77
Validation auc = 0.637273
Epoch 78
Validation auc = 0.628034
Epoch 79
Validation auc = 0.618303
Epoch 80
Loss = 5.3826e-01, PNorm = 74.2566, GNorm = 1.2694, lr_0 = 9.9802e-04
Validation auc = 0.609337
Epoch 81
Validation auc = 0.589438
Epoch 82
Validation auc = 0.628909
Epoch 83
Validation auc = 0.646184
Epoch 84
Loss = 4.5970e-01, PNorm = 74.5732, GNorm = 0.3457, lr_0 = 9.9779e-04
Loss = 3.2303e-01, PNorm = 74.6034, GNorm = 1.0820, lr_0 = 9.9777e-04
Validation auc = 0.652526
Epoch 85
Validation auc = 0.605019
Epoch 86
Validation auc = 0.672972
Epoch 87
Validation auc = 0.663405
Epoch 88
Validation auc = 0.643779
Epoch 89
Loss = 5.8967e-01, PNorm = 74.9722, GNorm = 3.9305, lr_0 = 9.9752e-04
Loss = 6.8050e-01, PNorm = 75.0017, GNorm = 3.1252, lr_0 = 9.9750e-04
Validation auc = 0.628307
Epoch 90
Validation auc = 0.618959
Epoch 91
Validation auc = 0.604855
Epoch 92
Validation auc = 0.593593
Epoch 93
Validation auc = 0.586650
Epoch 94
Loss = 3.6986e-01, PNorm = 75.4057, GNorm = 0.6103, lr_0 = 9.9727e-04
Validation auc = 0.585830
Epoch 95
Validation auc = 0.641100
Epoch 96
Validation auc = 0.649027
Epoch 97
Validation auc = 0.653783
Epoch 98
Validation auc = 0.673300
Epoch 99
Loss = 5.2223e-01, PNorm = 75.9403, GNorm = 1.0595, lr_0 = 9.9701e-04
Validation auc = 0.659687
Epoch 100
Validation auc = 0.648808
Epoch 101
Validation auc = 0.631041
Epoch 102
Validation auc = 0.627378
Epoch 103
Loss = 4.8184e-01, PNorm = 76.3911, GNorm = 0.9355, lr_0 = 9.9678e-04
Loss = 2.9646e-01, PNorm = 76.4192, GNorm = 0.7955, lr_0 = 9.9676e-04
Validation auc = 0.622021
Epoch 104
Validation auc = 0.610212
Epoch 105
Validation auc = 0.600481
Epoch 106
Validation auc = 0.597201
Epoch 107
Validation auc = 0.647934
Epoch 108
Loss = 4.3933e-01, PNorm = 76.7499, GNorm = 2.2156, lr_0 = 9.9651e-04
Validation auc = 0.675432
Epoch 109
Validation auc = 0.675815
Epoch 110
Validation auc = 0.684507
Epoch 111
Validation auc = 0.647824
Epoch 112
Validation auc = 0.639733
Epoch 113
Loss = 3.9805e-01, PNorm = 77.0490, GNorm = 1.0805, lr_0 = 9.9627e-04
Validation auc = 0.643068
Epoch 114
Validation auc = 0.637710
Epoch 115
Validation auc = 0.639351
Epoch 116
Validation auc = 0.639679
Epoch 117
Loss = 3.4848e-01, PNorm = 77.3254, GNorm = 0.7565, lr_0 = 9.9604e-04
Loss = 3.1464e-01, PNorm = 77.3495, GNorm = 2.3302, lr_0 = 9.9602e-04
Validation auc = 0.625738
Epoch 118
Validation auc = 0.619888
Epoch 119
Validation auc = 0.621966
Epoch 120
Validation auc = 0.640772
Epoch 121
Validation auc = 0.635742
Epoch 122
Loss = 1.8793e-01, PNorm = 77.6709, GNorm = 0.7562, lr_0 = 9.9577e-04
Loss = 3.6671e-02, PNorm = 77.6940, GNorm = 0.5278, lr_0 = 9.9575e-04
Validation auc = 0.638257
Epoch 123
Validation auc = 0.627651
Epoch 124
Validation auc = 0.632681
Epoch 125
Validation auc = 0.631041
Epoch 126
Validation auc = 0.634430
Epoch 127
Loss = 3.5480e-01, PNorm = 77.9669, GNorm = 3.8103, lr_0 = 9.9552e-04
Validation auc = 0.619178
Epoch 128
Validation auc = 0.609611
Epoch 129
Validation auc = 0.629784
Epoch 130
Validation auc = 0.626777
Epoch 131
Validation auc = 0.621638
Epoch 132
Loss = 1.7551e-01, PNorm = 78.2749, GNorm = 0.8478, lr_0 = 9.9526e-04
Validation auc = 0.636180
Epoch 133
Validation auc = 0.622731
Epoch 134
Validation auc = 0.648918
Epoch 135
Validation auc = 0.679095
Epoch 136
Loss = 2.8674e-01, PNorm = 78.5641, GNorm = 1.2259, lr_0 = 9.9503e-04
Loss = 2.5047e-01, PNorm = 78.5910, GNorm = 4.6554, lr_0 = 9.9501e-04
Validation auc = 0.690848
Epoch 137
Validation auc = 0.695659
Epoch 138
Validation auc = 0.697791
Epoch 139
Validation auc = 0.681500
Epoch 140
Validation auc = 0.666521
Epoch 141
Loss = 3.5020e-01, PNorm = 78.9345, GNorm = 2.8861, lr_0 = 9.9477e-04
Validation auc = 0.653346
Epoch 142
Validation auc = 0.642467
Epoch 143
Validation auc = 0.646567
Epoch 144
Validation auc = 0.656407
Epoch 145
Validation auc = 0.671332
Epoch 146
Loss = 1.4582e-01, PNorm = 79.2084, GNorm = 0.6284, lr_0 = 9.9452e-04
Validation auc = 0.672862
Epoch 147
Validation auc = 0.670785
Epoch 148
Validation auc = 0.679969
Epoch 149
Validation auc = 0.663241
Epoch 150
Loss = 2.9294e-01, PNorm = 79.4093, GNorm = 2.1940, lr_0 = 9.9429e-04
Loss = 1.9760e-01, PNorm = 79.4304, GNorm = 4.4400, lr_0 = 9.9427e-04
Validation auc = 0.624481
Epoch 151
Validation auc = 0.629510
Epoch 152
Validation auc = 0.683906
Epoch 153
Validation auc = 0.656845
Epoch 154
Validation auc = 0.671277
Epoch 155
Loss = 2.6230e-01, PNorm = 79.7898, GNorm = 1.5705, lr_0 = 9.9403e-04
Loss = 4.9068e-01, PNorm = 79.8216, GNorm = 5.0886, lr_0 = 9.9401e-04
Validation auc = 0.686584
Epoch 156
Validation auc = 0.687350
Epoch 157
Validation auc = 0.693145
Epoch 158
Validation auc = 0.709928
Epoch 159
Validation auc = 0.679259
Epoch 160
Loss = 1.9192e-01, PNorm = 80.1513, GNorm = 0.7683, lr_0 = 9.9378e-04
Validation auc = 0.655423
Epoch 161
Validation auc = 0.665264
Epoch 162
Validation auc = 0.664225
Epoch 163
Validation auc = 0.660890
Epoch 164
Validation auc = 0.651104
Epoch 165
Loss = 3.5932e-01, PNorm = 80.4383, GNorm = 1.3568, lr_0 = 9.9351e-04
Validation auc = 0.639296
Epoch 166
Validation auc = 0.649574
Epoch 167
Validation auc = 0.659961
Epoch 168
Validation auc = 0.660999
Epoch 169
Loss = 1.5500e-01, PNorm = 80.7601, GNorm = 2.0563, lr_0 = 9.9329e-04
Loss = 2.6550e-01, PNorm = 80.7821, GNorm = 8.4598, lr_0 = 9.9327e-04
Validation auc = 0.658321
Epoch 170
Validation auc = 0.658321
Epoch 171
Validation auc = 0.652908
Epoch 172
Validation auc = 0.645637
Epoch 173
Validation auc = 0.641045
Epoch 174
Loss = 8.7569e-02, PNorm = 81.0761, GNorm = 1.6073, lr_0 = 9.9302e-04
Validation auc = 0.638695
Epoch 175
Validation auc = 0.626011
Epoch 176
Validation auc = 0.637328
Epoch 177
Validation auc = 0.639023
Epoch 178
Validation auc = 0.639296
Epoch 179
Loss = 1.7475e-01, PNorm = 81.3075, GNorm = 0.8413, lr_0 = 9.9277e-04
Validation auc = 0.641537
Epoch 180
Validation auc = 0.641975
Epoch 181
Validation auc = 0.637874
Epoch 182
Validation auc = 0.654767
Epoch 183
Loss = 2.3383e-01, PNorm = 81.4889, GNorm = 0.1999, lr_0 = 9.9253e-04
Validation auc = 0.652416
Epoch 184
Validation auc = 0.642576
Epoch 185
Validation auc = 0.636180
Epoch 186
Validation auc = 0.631369
Epoch 187
Validation auc = 0.624590
Epoch 188
Loss = 9.2681e-02, PNorm = 81.6482, GNorm = 1.3844, lr_0 = 9.9228e-04
Loss = 1.0568e-01, PNorm = 81.6605, GNorm = 2.0333, lr_0 = 9.9226e-04
Validation auc = 0.625793
Epoch 189
Validation auc = 0.629291
Epoch 190
Validation auc = 0.633064
Epoch 191
Validation auc = 0.638312
Epoch 192
Validation auc = 0.635906
Epoch 193
Loss = 1.1372e-02, PNorm = 81.8286, GNorm = 0.3358, lr_0 = 9.9204e-04
Validation auc = 0.635086
Epoch 194
Validation auc = 0.645801
Epoch 195
Validation auc = 0.647824
Epoch 196
Validation auc = 0.646075
Epoch 197
Validation auc = 0.673518
Epoch 198
Loss = 3.8165e-02, PNorm = 81.9973, GNorm = 1.8153, lr_0 = 9.9177e-04
Validation auc = 0.690356
Epoch 199
Validation auc = 0.691012
Epoch 200
Validation auc = 0.684616
Epoch 201
Validation auc = 0.674940
Epoch 202
Loss = 4.1126e-02, PNorm = 82.1633, GNorm = 1.5184, lr_0 = 9.9154e-04
Loss = 9.4742e-02, PNorm = 82.1771, GNorm = 3.4681, lr_0 = 9.9153e-04
Validation auc = 0.656243
Epoch 203
Validation auc = 0.633884
Epoch 204
Validation auc = 0.612891
Epoch 205
Validation auc = 0.610649
Epoch 206
Validation auc = 0.615570
Epoch 207
Loss = 1.0435e-01, PNorm = 82.3293, GNorm = 0.4558, lr_0 = 9.9128e-04
Loss = 1.4484e-02, PNorm = 82.3412, GNorm = 0.2035, lr_0 = 9.9126e-04
Validation auc = 0.621638
Epoch 208
Validation auc = 0.628963
Epoch 209
Validation auc = 0.630604
Epoch 210
Validation auc = 0.633173
Epoch 211
Validation auc = 0.661327
Epoch 212
Loss = 1.7008e-01, PNorm = 82.4350, GNorm = 0.7593, lr_0 = 9.9103e-04
Validation auc = 0.688716
Epoch 213
Validation auc = 0.706046
Epoch 214
Validation auc = 0.711513
Epoch 215
Validation auc = 0.708506
Epoch 216
Loss = 1.1302e-01, PNorm = 82.6364, GNorm = 1.3308, lr_0 = 9.9079e-04
Validation auc = 0.703040
Epoch 217
Validation auc = 0.692598
Epoch 218
Validation auc = 0.677728
Epoch 219
Validation auc = 0.673518
Epoch 220
Validation auc = 0.668489
Epoch 221
Loss = 1.3811e-01, PNorm = 82.9142, GNorm = 2.0143, lr_0 = 9.9054e-04
Loss = 3.6110e-02, PNorm = 82.9334, GNorm = 0.8371, lr_0 = 9.9052e-04
Validation auc = 0.659086
Epoch 222
Validation auc = 0.651214
Epoch 223
Validation auc = 0.646348
Epoch 224
Validation auc = 0.643669
Epoch 225
Validation auc = 0.638749
Epoch 226
Loss = 8.5498e-03, PNorm = 83.1167, GNorm = 0.2764, lr_0 = 9.9030e-04
Validation auc = 0.630440
Epoch 227
Validation auc = 0.625410
Epoch 228
Validation auc = 0.660617
Epoch 229
Validation auc = 0.670184
Epoch 230
Validation auc = 0.659195
Epoch 231
Loss = 1.7104e-02, PNorm = 83.2507, GNorm = 0.7657, lr_0 = 9.9003e-04
Validation auc = 0.648207
Epoch 232
Validation auc = 0.642248
Epoch 233
Validation auc = 0.640991
Epoch 234
Validation auc = 0.645473
Epoch 235
Loss = 1.5150e-01, PNorm = 83.3914, GNorm = 2.9111, lr_0 = 9.8980e-04
Loss = 8.8983e-04, PNorm = 83.4000, GNorm = 0.0335, lr_0 = 9.8979e-04
Validation auc = 0.649191
Epoch 236
Validation auc = 0.652799
Epoch 237
Validation auc = 0.643997
Epoch 238
Validation auc = 0.627597
Epoch 239
Validation auc = 0.623770
Epoch 240
Loss = 2.6725e-01, PNorm = 83.5200, GNorm = 2.2647, lr_0 = 9.8954e-04
Loss = 1.7423e-03, PNorm = 83.5347, GNorm = 0.0352, lr_0 = 9.8952e-04
Validation auc = 0.654767
Epoch 241
Validation auc = 0.673245
Epoch 242
Validation auc = 0.681828
Epoch 243
Validation auc = 0.686092
Epoch 244
Validation auc = 0.684835
Epoch 245
Loss = 4.1259e-02, PNorm = 83.7192, GNorm = 0.5148, lr_0 = 9.8930e-04
Validation auc = 0.689536
Epoch 246
Validation auc = 0.678111
Epoch 247
Validation auc = 0.664279
Epoch 248
Validation auc = 0.657501
Epoch 249
Loss = 1.5747e-01, PNorm = 83.9030, GNorm = 0.8518, lr_0 = 9.8905e-04
Validation auc = 0.651487
Epoch 250
Validation auc = 0.651924
Epoch 251
Validation auc = 0.654931
Epoch 252
Validation auc = 0.654822
Epoch 253
Validation auc = 0.653892
Epoch 254
Loss = 8.7487e-02, PNorm = 84.0511, GNorm = 0.4595, lr_0 = 9.8880e-04
Loss = 1.0450e-01, PNorm = 84.0601, GNorm = 6.5736, lr_0 = 9.8879e-04
Validation auc = 0.650831
Epoch 255
Validation auc = 0.643560
Epoch 256
Validation auc = 0.639952
Epoch 257
Validation auc = 0.642303
Epoch 258
Validation auc = 0.645036
Epoch 259
Loss = 2.7264e-02, PNorm = 84.1591, GNorm = 1.1106, lr_0 = 9.8856e-04
Validation auc = 0.651432
Epoch 260
Validation auc = 0.654767
Epoch 261
Validation auc = 0.649683
Epoch 262
Validation auc = 0.615351
Epoch 263
Validation auc = 0.604253
Epoch 264
Loss = 1.7331e-01, PNorm = 84.2887, GNorm = 1.2652, lr_0 = 9.8830e-04
Validation auc = 0.599661
Epoch 265
Validation auc = 0.592773
Epoch 266
Validation auc = 0.599497
Epoch 267
Validation auc = 0.607643
Epoch 268
Loss = 1.8471e-01, PNorm = 84.5585, GNorm = 1.3491, lr_0 = 9.8807e-04
Loss = 4.1271e-02, PNorm = 84.5803, GNorm = 0.3916, lr_0 = 9.8805e-04
Validation auc = 0.611688
Epoch 269
Validation auc = 0.621255
Epoch 270
Validation auc = 0.631314
Epoch 271
Validation auc = 0.635032
Epoch 272
Validation auc = 0.629893
Epoch 273
Loss = 1.0839e-01, PNorm = 84.8235, GNorm = 1.6678, lr_0 = 9.8781e-04
Loss = 4.6901e-03, PNorm = 84.8378, GNorm = 0.0897, lr_0 = 9.8779e-04
Validation auc = 0.632626
Epoch 274
Validation auc = 0.644981
Epoch 275
Validation auc = 0.649410
Epoch 276
Validation auc = 0.650066
Epoch 277
Validation auc = 0.642631
Epoch 278
Loss = 1.6678e-01, PNorm = 85.0046, GNorm = 4.5528, lr_0 = 9.8756e-04
Validation auc = 0.642139
Epoch 279
Validation auc = 0.646293
Epoch 280
Validation auc = 0.629784
Epoch 281
Validation auc = 0.618576
Epoch 282
Validation auc = 0.612344
Epoch 283
Loss = 2.8547e-02, PNorm = 85.2482, GNorm = 1.1102, lr_0 = 9.8730e-04
Validation auc = 0.615132
Epoch 284
Validation auc = 0.622895
Epoch 285
Validation auc = 0.630330
Epoch 286
Validation auc = 0.627050
Epoch 287
Loss = 9.6734e-02, PNorm = 85.5097, GNorm = 2.1806, lr_0 = 9.8707e-04
Loss = 8.3369e-03, PNorm = 85.5289, GNorm = 0.2421, lr_0 = 9.8705e-04
Validation auc = 0.628799
Epoch 288
Validation auc = 0.632134
Epoch 289
Validation auc = 0.625847
Epoch 290
Validation auc = 0.620490
Epoch 291
Validation auc = 0.615898
Epoch 292
Loss = 3.2353e-02, PNorm = 85.7034, GNorm = 1.4628, lr_0 = 9.8683e-04
Validation auc = 0.616936
Epoch 293
Validation auc = 0.615187
Epoch 294
Validation auc = 0.609283
Epoch 295
Validation auc = 0.609009
Epoch 296
Validation auc = 0.606385
Epoch 297
Loss = 8.1565e-02, PNorm = 85.8274, GNorm = 1.9027, lr_0 = 9.8656e-04
Validation auc = 0.604472
Epoch 298
Validation auc = 0.599989
Epoch 299
Validation auc = 0.604035
Epoch 300
Validation auc = 0.608299
Epoch 301
Loss = 5.3472e-02, PNorm = 85.9754, GNorm = 0.4789, lr_0 = 9.8634e-04
Loss = 1.1848e-02, PNorm = 85.9858, GNorm = 0.2099, lr_0 = 9.8632e-04
Validation auc = 0.609829
Epoch 302
Validation auc = 0.613328
Epoch 303
Validation auc = 0.614531
Epoch 304
Validation auc = 0.617210
Epoch 305
Validation auc = 0.619451
Epoch 306
Loss = 1.3465e-02, PNorm = 86.0746, GNorm = 0.1664, lr_0 = 9.8607e-04
Loss = 3.8855e-03, PNorm = 86.0805, GNorm = 0.0737, lr_0 = 9.8606e-04
Validation auc = 0.620654
Epoch 307
Validation auc = 0.621310
Epoch 308
Validation auc = 0.621365
Epoch 309
Validation auc = 0.621419
Epoch 310
Validation auc = 0.622349
Epoch 311
Loss = 1.4695e-01, PNorm = 86.1362, GNorm = 1.0675, lr_0 = 9.8583e-04
Validation auc = 0.619451
Epoch 312
Validation auc = 0.622950
Epoch 313
Validation auc = 0.619396
Epoch 314
Validation auc = 0.609993
Epoch 315
Validation auc = 0.611634
Epoch 316
Loss = 2.8678e-02, PNorm = 86.1800, GNorm = 0.7188, lr_0 = 9.8557e-04
Validation auc = 0.618303
Epoch 317
Validation auc = 0.620380
Epoch 318
Validation auc = 0.622841
Epoch 319
Validation auc = 0.623223
Epoch 320
Loss = 1.0177e-01, PNorm = 86.3124, GNorm = 0.9019, lr_0 = 9.8534e-04
Loss = 6.7273e-03, PNorm = 86.3254, GNorm = 0.3235, lr_0 = 9.8532e-04
Validation auc = 0.620709
Epoch 321
Validation auc = 0.616335
Epoch 322
Validation auc = 0.614968
Epoch 323
Validation auc = 0.612891
Epoch 324
Validation auc = 0.614640
Epoch 325
Loss = 3.0043e-02, PNorm = 86.4837, GNorm = 1.3467, lr_0 = 9.8509e-04
Validation auc = 0.614039
Epoch 326
Validation auc = 0.614312
Epoch 327
Validation auc = 0.614148
Epoch 328
Validation auc = 0.617100
Epoch 329
Validation auc = 0.621037
Epoch 330
Loss = 8.0923e-02, PNorm = 86.5831, GNorm = 0.9379, lr_0 = 9.8483e-04
Validation auc = 0.622950
Epoch 331
Validation auc = 0.625027
Epoch 332
Validation auc = 0.623551
Epoch 333
Validation auc = 0.628307
Epoch 334
Loss = 1.4036e-01, PNorm = 86.6188, GNorm = 1.1374, lr_0 = 9.8461e-04
Loss = 6.0008e-04, PNorm = 86.6186, GNorm = 0.0156, lr_0 = 9.8459e-04
Validation auc = 0.634813
Epoch 335
Validation auc = 0.646184
Epoch 336
Validation auc = 0.653619
Epoch 337
Validation auc = 0.662475
Epoch 338
Validation auc = 0.667450
Epoch 339
Loss = 8.2702e-02, PNorm = 86.6789, GNorm = 0.5916, lr_0 = 9.8434e-04
Loss = 1.3238e-03, PNorm = 86.6834, GNorm = 0.0272, lr_0 = 9.8433e-04
Validation auc = 0.669036
Epoch 340
Validation auc = 0.670074
Epoch 341
Validation auc = 0.672480
Epoch 342
Validation auc = 0.673190
Epoch 343
Validation auc = 0.672644
Epoch 344
Loss = 1.5465e-01, PNorm = 86.7437, GNorm = 1.5884, lr_0 = 9.8410e-04
Validation auc = 0.673136
Epoch 345
Validation auc = 0.674284
Epoch 346
Validation auc = 0.675651
Epoch 347
Validation auc = 0.676799
Epoch 348
Validation auc = 0.678220
Epoch 349
Loss = 8.0149e-03, PNorm = 86.8150, GNorm = 0.2881, lr_0 = 9.8384e-04
Validation auc = 0.678001
Epoch 350
Validation auc = 0.676799
Epoch 351
Validation auc = 0.677017
Epoch 352
Validation auc = 0.674229
Epoch 353
Loss = 2.2216e-02, PNorm = 86.8617, GNorm = 2.6348, lr_0 = 9.8361e-04
Loss = 9.3200e-04, PNorm = 86.8649, GNorm = 0.0275, lr_0 = 9.8359e-04
Validation auc = 0.672152
Epoch 354
Validation auc = 0.669856
Epoch 355
Validation auc = 0.676143
Epoch 356
Validation auc = 0.688115
Epoch 357
Validation auc = 0.686912
Epoch 358
Loss = 1.0552e-01, PNorm = 87.0069, GNorm = 1.3759, lr_0 = 9.8335e-04
Validation auc = 0.685983
Epoch 359
Validation auc = 0.689482
Epoch 360
Validation auc = 0.687678
Epoch 361
Validation auc = 0.685928
Epoch 362
Validation auc = 0.684616
Epoch 363
Loss = 3.8379e-02, PNorm = 87.2571, GNorm = 0.7201, lr_0 = 9.8311e-04
Validation auc = 0.683031
Epoch 364
Validation auc = 0.685655
Epoch 365
Validation auc = 0.674393
Epoch 366
Validation auc = 0.668489
Epoch 367
Loss = 6.5743e-02, PNorm = 87.4932, GNorm = 0.9313, lr_0 = 9.8288e-04
Loss = 5.3688e-02, PNorm = 87.5108, GNorm = 3.9683, lr_0 = 9.8286e-04
Validation auc = 0.662038
Epoch 368
Validation auc = 0.657501
Epoch 369
Validation auc = 0.655478
Epoch 370
Validation auc = 0.664170
Epoch 371
Validation auc = 0.664443
Epoch 372
Loss = 1.0458e-01, PNorm = 87.7619, GNorm = 1.5654, lr_0 = 9.8262e-04
Loss = 5.8215e-04, PNorm = 87.7788, GNorm = 0.0185, lr_0 = 9.8260e-04
Validation auc = 0.671222
Epoch 373
Validation auc = 0.682757
Epoch 374
Validation auc = 0.691942
Epoch 375
Validation auc = 0.694675
Epoch 376
Validation auc = 0.689700
Epoch 377
Loss = 7.8316e-03, PNorm = 87.9756, GNorm = 0.0977, lr_0 = 9.8237e-04
Validation auc = 0.685491
Epoch 378
Validation auc = 0.682156
Epoch 379
Validation auc = 0.679805
Epoch 380
Validation auc = 0.678165
Epoch 381
Validation auc = 0.674776
Epoch 382
Loss = 1.2395e-02, PNorm = 88.1269, GNorm = 0.3444, lr_0 = 9.8211e-04
Validation auc = 0.671769
Epoch 383
Validation auc = 0.669254
Epoch 384
Validation auc = 0.667396
Epoch 385
Validation auc = 0.665592
Epoch 386
Loss = 2.1352e-03, PNorm = 88.1945, GNorm = 0.0280, lr_0 = 9.8189e-04
Loss = 8.3974e-04, PNorm = 88.1981, GNorm = 0.0271, lr_0 = 9.8187e-04
Validation auc = 0.663241
Epoch 387
Validation auc = 0.663295
Epoch 388
Validation auc = 0.663787
Epoch 389
Validation auc = 0.666029
Epoch 390
Validation auc = 0.671496
Epoch 391
Loss = 1.3170e-02, PNorm = 88.2560, GNorm = 1.5607, lr_0 = 9.8163e-04
Validation auc = 0.675651
Epoch 392
Validation auc = 0.674010
Epoch 393
Validation auc = 0.665537
Epoch 394
Validation auc = 0.660835
Epoch 395
Validation auc = 0.655423
Epoch 396
Loss = 1.0313e-02, PNorm = 88.2983, GNorm = 0.1781, lr_0 = 9.8138e-04
Validation auc = 0.651596
Epoch 397
Validation auc = 0.648098
Epoch 398
Validation auc = 0.642576
Epoch 399
Validation auc = 0.640663
Epoch 400
Loss = 1.2109e-01, PNorm = 88.3734, GNorm = 0.7954, lr_0 = 9.8116e-04
Loss = 2.5697e-01, PNorm = 88.3786, GNorm = 8.2006, lr_0 = 9.8114e-04
Validation auc = 0.633009
Epoch 401
Validation auc = 0.634649
Epoch 402
Validation auc = 0.646785
Epoch 403
Validation auc = 0.659086
Epoch 404
Validation auc = 0.663514
Epoch 405
Loss = 6.1977e-02, PNorm = 88.5264, GNorm = 2.0516, lr_0 = 9.8089e-04
Loss = 1.6500e-03, PNorm = 88.5382, GNorm = 0.0395, lr_0 = 9.8088e-04
Validation auc = 0.657446
Epoch 406
Validation auc = 0.654767
Epoch 407
Validation auc = 0.653072
Epoch 408
Validation auc = 0.651432
Epoch 409
Validation auc = 0.651432
Epoch 410
Loss = 1.9850e-02, PNorm = 88.6649, GNorm = 0.9321, lr_0 = 9.8065e-04
Validation auc = 0.649519
Epoch 411
Validation auc = 0.645145
Epoch 412
Validation auc = 0.645637
Epoch 413
Validation auc = 0.647387
Epoch 414
Validation auc = 0.647332
Epoch 415
Loss = 8.8118e-02, PNorm = 88.7615, GNorm = 2.5627, lr_0 = 9.8039e-04
Validation auc = 0.646348
Epoch 416
Validation auc = 0.645255
Epoch 417
Validation auc = 0.640553
Epoch 418
Validation auc = 0.632408
Epoch 419
Loss = 4.2903e-03, PNorm = 88.8410, GNorm = 0.0878, lr_0 = 9.8016e-04
Loss = 1.3466e-04, PNorm = 88.8464, GNorm = 0.0041, lr_0 = 9.8015e-04
Validation auc = 0.626066
Epoch 420
Validation auc = 0.620818
Epoch 421
Validation auc = 0.618631
Epoch 422
Validation auc = 0.617866
Epoch 423
Validation auc = 0.618850
Epoch 424
Loss = 6.4105e-02, PNorm = 88.9127, GNorm = 0.4710, lr_0 = 9.7990e-04
Validation auc = 0.621747
Epoch 425
Validation auc = 0.625082
Epoch 426
Validation auc = 0.626667
Epoch 427
Validation auc = 0.638640
Epoch 428
Validation auc = 0.643013
Epoch 429
Loss = 1.7426e-01, PNorm = 88.9972, GNorm = 5.3449, lr_0 = 9.7966e-04
Validation auc = 0.639843
Epoch 430
Validation auc = 0.648699
Epoch 431
Validation auc = 0.655150
Epoch 432
Validation auc = 0.659633
Epoch 433
Loss = 1.1089e-01, PNorm = 89.2856, GNorm = 0.5346, lr_0 = 9.7942e-04
Validation auc = 0.669309
Epoch 434
Validation auc = 0.679259
Epoch 435
Validation auc = 0.694511
Epoch 436
Validation auc = 0.705445
Epoch 437
Validation auc = 0.705992
Epoch 438
Loss = 2.3429e-02, PNorm = 89.5448, GNorm = 0.3045, lr_0 = 9.7917e-04
Loss = 5.1362e-03, PNorm = 89.5593, GNorm = 0.1060, lr_0 = 9.7916e-04
Validation auc = 0.705554
Epoch 439
Validation auc = 0.704242
Epoch 440
Validation auc = 0.700415
Epoch 441
Validation auc = 0.697463
Epoch 442
Validation auc = 0.690520
Epoch 443
Loss = 7.7839e-02, PNorm = 89.6892, GNorm = 2.5581, lr_0 = 9.7893e-04
Validation auc = 0.684726
Epoch 444
Validation auc = 0.682101
Epoch 445
Validation auc = 0.676908
Epoch 446
Validation auc = 0.668489
Epoch 447
Validation auc = 0.663077
Epoch 448
Loss = 3.1764e-02, PNorm = 89.7724, GNorm = 0.9989, lr_0 = 9.7867e-04
Validation auc = 0.659469
Epoch 449
Validation auc = 0.654494
Epoch 450
Validation auc = 0.667396
Epoch 451
Validation auc = 0.677400
Epoch 452
Loss = 3.0290e-02, PNorm = 89.8702, GNorm = 0.7197, lr_0 = 9.7845e-04
Loss = 2.3181e-03, PNorm = 89.8790, GNorm = 0.0601, lr_0 = 9.7843e-04
Validation auc = 0.686967
Epoch 453
Validation auc = 0.698611
Epoch 454
Validation auc = 0.706812
Epoch 455
Validation auc = 0.699650
Epoch 456
Validation auc = 0.693965
Epoch 457
Loss = 1.9801e-02, PNorm = 89.9675, GNorm = 0.1224, lr_0 = 9.7819e-04
Loss = 7.6938e-03, PNorm = 89.9721, GNorm = 0.3010, lr_0 = 9.7817e-04
Validation auc = 0.690958
Epoch 458
Validation auc = 0.689864
Epoch 459
Validation auc = 0.688334
Epoch 460
Validation auc = 0.686202
Epoch 461
Validation auc = 0.681992
Epoch 462
Loss = 5.5305e-02, PNorm = 90.0296, GNorm = 0.6860, lr_0 = 9.7794e-04
Validation auc = 0.681883
Epoch 463
Validation auc = 0.694675
Epoch 464
Validation auc = 0.689755
Epoch 465
Validation auc = 0.673026
Epoch 466
Loss = 2.2814e-01, PNorm = 90.1727, GNorm = 0.5021, lr_0 = 9.7770e-04
Validation auc = 0.670621
Epoch 467
Validation auc = 0.662749
Epoch 468
Validation auc = 0.653783
Epoch 469
Validation auc = 0.642467
Epoch 470
Validation auc = 0.638202
Epoch 471
Loss = 5.5686e-02, PNorm = 90.4314, GNorm = 0.3229, lr_0 = 9.7746e-04
Loss = 2.5276e-02, PNorm = 90.4505, GNorm = 0.4222, lr_0 = 9.7744e-04
Validation auc = 0.637601
Epoch 472
Validation auc = 0.638257
Epoch 473
Validation auc = 0.642521
Epoch 474
Validation auc = 0.646676
Epoch 475
Validation auc = 0.643451
Epoch 476
Loss = 1.2860e-01, PNorm = 90.6705, GNorm = 0.9692, lr_0 = 9.7721e-04
Validation auc = 0.635961
Epoch 477
Validation auc = 0.628635
Epoch 478
Validation auc = 0.623715
Epoch 479
Validation auc = 0.623059
Epoch 480
Validation auc = 0.619998
Epoch 481
Loss = 1.8647e-02, PNorm = 90.8580, GNorm = 0.2546, lr_0 = 9.7695e-04
Validation auc = 0.617756
Epoch 482
Validation auc = 0.616116
Epoch 483
Validation auc = 0.614695
Epoch 484
Validation auc = 0.621201
Epoch 485
Loss = 2.5220e-03, PNorm = 90.9843, GNorm = 0.0872, lr_0 = 9.7673e-04
Loss = 7.4535e-04, PNorm = 90.9914, GNorm = 0.0225, lr_0 = 9.7671e-04
Validation auc = 0.627159
Epoch 486
Validation auc = 0.632790
Epoch 487
Validation auc = 0.630385
Epoch 488
Validation auc = 0.623770
Epoch 489
Validation auc = 0.624371
Epoch 490
Loss = 4.1987e-02, PNorm = 91.0762, GNorm = 0.0465, lr_0 = 9.7647e-04
Loss = 2.1381e-03, PNorm = 91.0829, GNorm = 0.0515, lr_0 = 9.7645e-04
Validation auc = 0.624809
Epoch 491
Validation auc = 0.623059
Epoch 492
Validation auc = 0.617210
Epoch 493
Validation auc = 0.615187
Epoch 494
Validation auc = 0.614094
Epoch 495
Loss = 4.4935e-02, PNorm = 91.1538, GNorm = 0.6327, lr_0 = 9.7623e-04
Validation auc = 0.614203
Epoch 496
Validation auc = 0.616171
Epoch 497
Validation auc = 0.619888
Epoch 498
Validation auc = 0.624043
Epoch 499
Loss = 5.4426e-03, PNorm = 91.2175, GNorm = 0.0533, lr_0 = 9.7599e-04
Validation auc = 0.628417
Epoch 500
Validation auc = 0.631533
Epoch 501
Validation auc = 0.633337
Epoch 502
Validation auc = 0.634266
Epoch 503
Validation auc = 0.633993
Epoch 504
Loss = 8.4307e-02, PNorm = 91.2812, GNorm = 1.7548, lr_0 = 9.7574e-04
Loss = 9.9208e-04, PNorm = 91.2833, GNorm = 0.0360, lr_0 = 9.7573e-04
Validation auc = 0.633228
Epoch 505
Validation auc = 0.631205
Epoch 506
Validation auc = 0.627979
Epoch 507
Validation auc = 0.626941
Epoch 508
Validation auc = 0.625847
Epoch 509
Loss = 1.1804e-02, PNorm = 91.3359, GNorm = 0.5318, lr_0 = 9.7550e-04
Validation auc = 0.625355
Epoch 510
Validation auc = 0.624535
Epoch 511
Validation auc = 0.622731
Epoch 512
Validation auc = 0.620107
Epoch 513
Validation auc = 0.619615
Epoch 514
Loss = 5.5021e-02, PNorm = 91.3659, GNorm = 1.0958, lr_0 = 9.7524e-04
Validation auc = 0.621091
Epoch 515
Validation auc = 0.618194
Epoch 516
Validation auc = 0.633720
Epoch 517
Validation auc = 0.650175
Epoch 518
Loss = 1.3288e-03, PNorm = 91.3955, GNorm = 0.0199, lr_0 = 9.7502e-04
Loss = 5.4890e-04, PNorm = 91.3991, GNorm = 0.0234, lr_0 = 9.7500e-04
Validation auc = 0.658649
Epoch 519
Validation auc = 0.662913
Epoch 520
Validation auc = 0.666029
Epoch 521
Validation auc = 0.667833
Epoch 522
Validation auc = 0.669254
Epoch 523
Loss = 1.0605e-03, PNorm = 91.4421, GNorm = 0.0355, lr_0 = 9.7476e-04
Loss = 3.0266e-04, PNorm = 91.4444, GNorm = 0.0210, lr_0 = 9.7474e-04
Validation auc = 0.670621
Epoch 524
Validation auc = 0.672425
Epoch 525
Validation auc = 0.671988
Epoch 526
Validation auc = 0.673300
Epoch 527
Validation auc = 0.672206
Epoch 528
Loss = 4.0032e-03, PNorm = 91.4670, GNorm = 0.0928, lr_0 = 9.7452e-04
Validation auc = 0.672316
Epoch 529
Validation auc = 0.671550
Epoch 530
Validation auc = 0.671168
Epoch 531
Validation auc = 0.671277
Epoch 532
Validation auc = 0.670457
Epoch 533
Loss = 1.5725e-03, PNorm = 91.5035, GNorm = 0.0741, lr_0 = 9.7426e-04
Validation auc = 0.669856
Epoch 534
Validation auc = 0.669528
Epoch 535
Validation auc = 0.668544
Epoch 536
Validation auc = 0.668380
Epoch 537
Loss = 5.1217e-02, PNorm = 91.5221, GNorm = 2.7862, lr_0 = 9.7403e-04
Loss = 3.2343e-05, PNorm = 91.5216, GNorm = 0.0021, lr_0 = 9.7401e-04
Validation auc = 0.668325
Epoch 538
Validation auc = 0.668161
Epoch 539
Validation auc = 0.667997
Epoch 540
Validation auc = 0.667669
Epoch 541
Validation auc = 0.667177
Epoch 542
Loss = 3.2933e-03, PNorm = 91.5183, GNorm = 0.0858, lr_0 = 9.7379e-04
Validation auc = 0.666302
Epoch 543
Validation auc = 0.665920
Epoch 544
Validation auc = 0.662147
Epoch 545
Validation auc = 0.659578
Epoch 546
Validation auc = 0.657774
Epoch 547
Loss = 7.9704e-04, PNorm = 91.5542, GNorm = 0.0149, lr_0 = 9.7353e-04
Validation auc = 0.655204
Epoch 548
Validation auc = 0.653947
Epoch 549
Validation auc = 0.653892
Epoch 550
Validation auc = 0.652744
Epoch 551
Loss = 3.7074e-03, PNorm = 91.5721, GNorm = 0.0737, lr_0 = 9.7331e-04
Loss = 9.4706e-04, PNorm = 91.5747, GNorm = 0.0227, lr_0 = 9.7329e-04
Validation auc = 0.652471
Epoch 552
Validation auc = 0.651432
Epoch 553
Validation auc = 0.650394
Epoch 554
Validation auc = 0.649355
Epoch 555
Validation auc = 0.649136
Epoch 556
Loss = 1.0889e-03, PNorm = 91.6152, GNorm = 0.0287, lr_0 = 9.7305e-04
Loss = 6.7963e-05, PNorm = 91.6178, GNorm = 0.0027, lr_0 = 9.7303e-04
Validation auc = 0.649082
Epoch 557
Validation auc = 0.649519
Epoch 558
Validation auc = 0.649082
Epoch 559
Validation auc = 0.647824
Epoch 560
Validation auc = 0.647715
Epoch 561
Loss = 1.6448e-03, PNorm = 91.6445, GNorm = 0.0436, lr_0 = 9.7281e-04
Validation auc = 0.649191
Epoch 562
Validation auc = 0.651979
Epoch 563
Validation auc = 0.654111
Epoch 564
Validation auc = 0.659141
Epoch 565
Validation auc = 0.661874
Epoch 566
Loss = 9.5785e-04, PNorm = 91.6854, GNorm = 0.0193, lr_0 = 9.7255e-04
Validation auc = 0.661601
Epoch 567
Validation auc = 0.660671
Epoch 568
Validation auc = 0.658813
Epoch 569
Validation auc = 0.657665
Epoch 570
Loss = 4.5865e-04, PNorm = 91.6977, GNorm = 0.0103, lr_0 = 9.7232e-04
Loss = 4.3775e-01, PNorm = 91.6993, GNorm = 22.9973, lr_0 = 9.7231e-04
Validation auc = 0.665154
Epoch 571
Validation auc = 0.673245
Epoch 572
Validation auc = 0.648972
Epoch 573
Validation auc = 0.625027
Epoch 574
Validation auc = 0.607971
Epoch 575
Loss = 1.0945e-01, PNorm = 91.9260, GNorm = 0.9602, lr_0 = 9.7208e-04
Validation auc = 0.605237
Epoch 576
Validation auc = 0.616554
Epoch 577
Validation auc = 0.631369
Epoch 578
Validation auc = 0.643615
Epoch 579
Validation auc = 0.648480
Epoch 580
Loss = 3.1589e-02, PNorm = 92.2765, GNorm = 0.8375, lr_0 = 9.7182e-04
Validation auc = 0.647606
Epoch 581
Validation auc = 0.647059
Epoch 582
Validation auc = 0.648371
Epoch 583
Validation auc = 0.650120
Epoch 584
Loss = 9.3611e-03, PNorm = 92.4806, GNorm = 0.1123, lr_0 = 9.7160e-04
Loss = 2.0460e-02, PNorm = 92.4944, GNorm = 0.3130, lr_0 = 9.7158e-04
Validation auc = 0.653510
Epoch 585
Validation auc = 0.658703
Epoch 586
Validation auc = 0.660070
Epoch 587
Validation auc = 0.660125
Epoch 588
Validation auc = 0.661327
Epoch 589
Loss = 3.1169e-02, PNorm = 92.6404, GNorm = 0.2645, lr_0 = 9.7134e-04
Loss = 6.2555e-05, PNorm = 92.6481, GNorm = 0.0028, lr_0 = 9.7132e-04
Validation auc = 0.656571
Epoch 590
Validation auc = 0.650503
Epoch 591
Validation auc = 0.640225
Epoch 592
Validation auc = 0.635524
Epoch 593
Validation auc = 0.634594
Epoch 594
Loss = 5.1507e-03, PNorm = 92.7191, GNorm = 0.1114, lr_0 = 9.7110e-04
Validation auc = 0.635141
Epoch 595
Validation auc = 0.636617
Epoch 596
Validation auc = 0.640499
Epoch 597
Validation auc = 0.640225
Epoch 598
Validation auc = 0.638531
Epoch 599
Loss = 1.3642e-01, PNorm = 92.8057, GNorm = 0.6825, lr_0 = 9.7084e-04
Validation auc = 0.638585
Epoch 600
Validation auc = 0.637765
Epoch 601
Validation auc = 0.635797
Epoch 602
Validation auc = 0.632134
Epoch 603
Loss = 7.2815e-03, PNorm = 92.8683, GNorm = 0.5439, lr_0 = 9.7062e-04
Loss = 2.3654e-03, PNorm = 92.8729, GNorm = 0.1459, lr_0 = 9.7060e-04
Validation auc = 0.630658
Epoch 604
Validation auc = 0.629565
Epoch 605
Validation auc = 0.608299
Epoch 606
Validation auc = 0.587853
Epoch 607
Validation auc = 0.623005
Epoch 608
Loss = 6.6907e-03, PNorm = 92.9351, GNorm = 0.1722, lr_0 = 9.7036e-04
Validation auc = 0.661437
Epoch 609
Validation auc = 0.673682
Epoch 610
Validation auc = 0.676908
Epoch 611
Validation auc = 0.670785
Epoch 612
Validation auc = 0.679969
Epoch 613
Loss = 4.5640e-02, PNorm = 93.1241, GNorm = 0.9230, lr_0 = 9.7012e-04
Validation auc = 0.683632
Epoch 614
Validation auc = 0.685108
Epoch 615
Validation auc = 0.694293
Epoch 616
Validation auc = 0.692817
Epoch 617
Loss = 7.1684e-03, PNorm = 93.2834, GNorm = 0.0976, lr_0 = 9.6990e-04
Loss = 3.8636e-03, PNorm = 93.2934, GNorm = 0.1244, lr_0 = 9.6988e-04
Validation auc = 0.688552
Epoch 618
Validation auc = 0.667778
Epoch 619
Validation auc = 0.664389
Epoch 620
Validation auc = 0.663077
Epoch 621
Validation auc = 0.664061
Epoch 622
Loss = 1.4031e-02, PNorm = 93.4223, GNorm = 1.0142, lr_0 = 9.6964e-04
Loss = 4.2784e-03, PNorm = 93.4300, GNorm = 0.1035, lr_0 = 9.6962e-04
Validation auc = 0.665373
Epoch 623
Validation auc = 0.665318
Epoch 624
Validation auc = 0.660726
Epoch 625
Validation auc = 0.658157
Epoch 626
Validation auc = 0.656243
Epoch 627
Loss = 1.6159e-03, PNorm = 93.5098, GNorm = 0.0393, lr_0 = 9.6940e-04
Validation auc = 0.654275
Epoch 628
Validation auc = 0.650612
Epoch 629
Validation auc = 0.648480
Epoch 630
Validation auc = 0.648644
Epoch 631
Validation auc = 0.649519
Epoch 632
Loss = 6.0886e-02, PNorm = 93.5579, GNorm = 0.8358, lr_0 = 9.6914e-04
Validation auc = 0.647715
Epoch 633
Validation auc = 0.645911
Epoch 634
Validation auc = 0.643341
Epoch 635
Validation auc = 0.644380
Epoch 636
Loss = 5.7105e-02, PNorm = 93.5787, GNorm = 0.0383, lr_0 = 9.6892e-04
Loss = 3.2967e-04, PNorm = 93.5801, GNorm = 0.0111, lr_0 = 9.6890e-04
Validation auc = 0.646020
Epoch 637
Validation auc = 0.648371
Epoch 638
Validation auc = 0.651050
Epoch 639
Validation auc = 0.652908
Epoch 640
Validation auc = 0.654166
Epoch 641
Loss = 4.9795e-02, PNorm = 93.6046, GNorm = 0.8672, lr_0 = 9.6866e-04
Validation auc = 0.652799
Epoch 642
Validation auc = 0.648535
Epoch 643
Validation auc = 0.643505
Epoch 644
Validation auc = 0.639788
Epoch 645
Validation auc = 0.637874
Epoch 646
Loss = 8.0372e-03, PNorm = 93.6525, GNorm = 0.1831, lr_0 = 9.6842e-04
Validation auc = 0.637382
Epoch 647
Validation auc = 0.636836
Epoch 648
Validation auc = 0.636945
Epoch 649
Validation auc = 0.637710
Epoch 650
Loss = 2.1006e-01, PNorm = 93.7045, GNorm = 1.2868, lr_0 = 9.6820e-04
Loss = 3.5164e-03, PNorm = 93.7054, GNorm = 0.0851, lr_0 = 9.6818e-04
Validation auc = 0.634102
Epoch 651
Validation auc = 0.630494
Epoch 652
Validation auc = 0.628143
Epoch 653
Validation auc = 0.629182
Epoch 654
Validation auc = 0.631096
Epoch 655
Loss = 9.0605e-03, PNorm = 93.7344, GNorm = 1.0729, lr_0 = 9.6794e-04
Loss = 9.3023e-04, PNorm = 93.7373, GNorm = 0.0255, lr_0 = 9.6792e-04
Validation auc = 0.630440
Epoch 656
Validation auc = 0.628854
Epoch 657
Validation auc = 0.627925
Epoch 658
Validation auc = 0.627487
Epoch 659
Validation auc = 0.644653
Epoch 660
Loss = 8.2151e-03, PNorm = 93.7755, GNorm = 0.2449, lr_0 = 9.6770e-04
Validation auc = 0.654767
Epoch 661
Validation auc = 0.655259
Epoch 662
Validation auc = 0.641537
Epoch 663
Validation auc = 0.638038
Epoch 664
Validation auc = 0.641756
Epoch 665
Loss = 1.6847e-01, PNorm = 94.0453, GNorm = 1.1041, lr_0 = 9.6744e-04
Validation auc = 0.649519
Epoch 666
Validation auc = 0.654056
Epoch 667
Validation auc = 0.658977
Epoch 668
Validation auc = 0.665701
Epoch 669
Loss = 4.3376e-02, PNorm = 94.3192, GNorm = 0.3761, lr_0 = 9.6722e-04
Loss = 1.3035e-02, PNorm = 94.3357, GNorm = 0.2916, lr_0 = 9.6720e-04
Validation auc = 0.669254
Epoch 670
Validation auc = 0.670566
Epoch 671
Validation auc = 0.670840
Epoch 672
Validation auc = 0.669692
Epoch 673
Validation auc = 0.668434
Epoch 674
Loss = 5.9416e-02, PNorm = 94.5117, GNorm = 0.1118, lr_0 = 9.6696e-04
Validation auc = 0.666740
Epoch 675
Validation auc = 0.666767
Epoch 676
Validation auc = 0.670512
Epoch 677
Validation auc = 0.679587
Epoch 678
Validation auc = 0.684671
Epoch 679
Loss = 5.2045e-03, PNorm = 94.6193, GNorm = 0.1207, lr_0 = 9.6672e-04
Validation auc = 0.687896
Epoch 680
Validation auc = 0.686256
Epoch 681
Validation auc = 0.683687
Epoch 682
Validation auc = 0.683140
Epoch 683
Loss = 1.6000e-03, PNorm = 94.7183, GNorm = 0.0311, lr_0 = 9.6648e-04
Validation auc = 0.681828
Epoch 684
Validation auc = 0.681609
Epoch 685
Validation auc = 0.682757
Epoch 686
Validation auc = 0.684234
Epoch 687
Validation auc = 0.684288
Epoch 688
Loss = 4.7212e-03, PNorm = 94.7788, GNorm = 0.9214, lr_0 = 9.6624e-04
Loss = 2.6173e-04, PNorm = 94.7825, GNorm = 0.0085, lr_0 = 9.6622e-04
Validation auc = 0.683796
Epoch 689
Validation auc = 0.684343
Epoch 690
Validation auc = 0.689208
Epoch 691
Validation auc = 0.696261
Epoch 692
Validation auc = 0.698065
Epoch 693
Loss = 8.5437e-02, PNorm = 94.8319, GNorm = 1.0974, lr_0 = 9.6600e-04
Validation auc = 0.695441
Epoch 694
Validation auc = 0.683523
Epoch 695
Validation auc = 0.663623
Epoch 696
Validation auc = 0.659359
Epoch 697
Validation auc = 0.651596
Epoch 698
Loss = 6.9372e-03, PNorm = 94.9266, GNorm = 0.0859, lr_0 = 9.6574e-04
Validation auc = 0.647277
Epoch 699
Validation auc = 0.644216
Epoch 700
Validation auc = 0.641756
Epoch 701
Validation auc = 0.634157
Epoch 702
Loss = 8.0442e-03, PNorm = 95.0146, GNorm = 0.0574, lr_0 = 9.6552e-04
Loss = 6.8039e-04, PNorm = 95.0197, GNorm = 0.0179, lr_0 = 9.6550e-04
Validation auc = 0.631205
Epoch 703
Validation auc = 0.627323
Epoch 704
Validation auc = 0.630822
Epoch 705
Validation auc = 0.633993
Epoch 706
Validation auc = 0.637546
Epoch 707
Loss = 7.9483e-02, PNorm = 95.0710, GNorm = 0.7510, lr_0 = 9.6526e-04
Loss = 3.8515e-03, PNorm = 95.0727, GNorm = 0.1494, lr_0 = 9.6525e-04
Validation auc = 0.637710
Epoch 708
Validation auc = 0.635196
Epoch 709
Validation auc = 0.635578
Epoch 710
Validation auc = 0.635906
Epoch 711
Validation auc = 0.636398
Epoch 712
Loss = 1.6595e-03, PNorm = 95.1041, GNorm = 0.0300, lr_0 = 9.6502e-04
Validation auc = 0.637382
Epoch 713
Validation auc = 0.637765
Epoch 714
Validation auc = 0.638476
Epoch 715
Validation auc = 0.639897
Epoch 716
Loss = 3.1256e-03, PNorm = 95.1300, GNorm = 0.0171, lr_0 = 9.6479e-04
Validation auc = 0.640991
Epoch 717
Validation auc = 0.643232
Epoch 718
Validation auc = 0.645692
Epoch 719
Validation auc = 0.646785
Epoch 720
Validation auc = 0.646020
Epoch 721
Loss = 4.4030e-03, PNorm = 95.1540, GNorm = 0.2440, lr_0 = 9.6455e-04
Loss = 1.5328e-03, PNorm = 95.1560, GNorm = 0.0288, lr_0 = 9.6453e-04
Validation auc = 0.645091
Epoch 722
Validation auc = 0.643833
Epoch 723
Validation auc = 0.642685
Epoch 724
Validation auc = 0.634048
Epoch 725
Validation auc = 0.646731
Epoch 726
Loss = 3.8883e-03, PNorm = 95.1734, GNorm = 0.1553, lr_0 = 9.6431e-04
Validation auc = 0.655970
Epoch 727
Validation auc = 0.663405
Epoch 728
Validation auc = 0.666904
Epoch 729
Validation auc = 0.670238
Epoch 730
Validation auc = 0.674339
Epoch 731
Loss = 3.0576e-03, PNorm = 95.1996, GNorm = 0.0825, lr_0 = 9.6405e-04
Validation auc = 0.676580
Epoch 732
Validation auc = 0.676471
Epoch 733
Validation auc = 0.676471
Epoch 734
Validation auc = 0.670894
Epoch 735
Loss = 1.7797e-02, PNorm = 95.2260, GNorm = 0.0410, lr_0 = 9.6383e-04
Loss = 3.0559e-03, PNorm = 95.2289, GNorm = 0.0591, lr_0 = 9.6381e-04
Validation auc = 0.664389
Epoch 736
Validation auc = 0.661983
Epoch 737
Validation auc = 0.660015
Epoch 738
Validation auc = 0.658867
Epoch 739
Validation auc = 0.654056
Epoch 740
Loss = 1.5619e-02, PNorm = 95.2794, GNorm = 0.0324, lr_0 = 9.6357e-04
Loss = 4.5984e-04, PNorm = 95.2846, GNorm = 0.0215, lr_0 = 9.6355e-04
Validation auc = 0.650011
Epoch 741
Validation auc = 0.645145
Epoch 742
Validation auc = 0.644216
Epoch 743
Validation auc = 0.643287
Epoch 744
Validation auc = 0.644216
Epoch 745
Loss = 1.1263e-03, PNorm = 95.3396, GNorm = 0.0205, lr_0 = 9.6333e-04
Validation auc = 0.644981
Epoch 746
Validation auc = 0.647059
Epoch 747
Validation auc = 0.648426
Epoch 748
Validation auc = 0.648754
Epoch 749
Loss = 2.3223e-03, PNorm = 95.3597, GNorm = 0.0373, lr_0 = 9.6309e-04
Validation auc = 0.648863
Epoch 750
Validation auc = 0.648808
Epoch 751
Validation auc = 0.648152
Epoch 752
Validation auc = 0.647770
Epoch 753
Validation auc = 0.647824
Epoch 754
Loss = 1.9986e-03, PNorm = 95.3738, GNorm = 0.1175, lr_0 = 9.6285e-04
Loss = 5.1091e-03, PNorm = 95.3747, GNorm = 0.1563, lr_0 = 9.6284e-04
Validation auc = 0.647387
Epoch 755
Validation auc = 0.647168
Epoch 756
Validation auc = 0.646676
Epoch 757
Validation auc = 0.646621
Epoch 758
Validation auc = 0.646348
Epoch 759
Loss = 8.9738e-02, PNorm = 95.3875, GNorm = 0.5541, lr_0 = 9.6262e-04
Validation auc = 0.645419
Epoch 760
Validation auc = 0.644161
Epoch 761
Validation auc = 0.643177
Epoch 762
Validation auc = 0.642959
Epoch 763
Validation auc = 0.642631
Epoch 764
Loss = 1.3720e-03, PNorm = 95.4045, GNorm = 0.0318, lr_0 = 9.6236e-04
Validation auc = 0.641701
Epoch 765
Validation auc = 0.640116
Epoch 766
Validation auc = 0.638202
Epoch 767
Validation auc = 0.636945
Epoch 768
Loss = 5.5078e-02, PNorm = 95.4153, GNorm = 0.7184, lr_0 = 9.6214e-04
Loss = 3.0275e-03, PNorm = 95.4162, GNorm = 0.1130, lr_0 = 9.6212e-04
Validation auc = 0.633228
Epoch 769
Validation auc = 0.632462
Epoch 770
Validation auc = 0.633446
Epoch 771
Validation auc = 0.634540
Epoch 772
Validation auc = 0.636289
Epoch 773
Loss = 5.0934e-03, PNorm = 95.4295, GNorm = 0.0738, lr_0 = 9.6188e-04
Loss = 3.6001e-03, PNorm = 95.4309, GNorm = 0.0857, lr_0 = 9.6186e-04
Validation auc = 0.637820
Epoch 774
Validation auc = 0.639679
Epoch 775
Validation auc = 0.634266
Epoch 776
Validation auc = 0.629237
Epoch 777
Validation auc = 0.625301
Epoch 778
Loss = 3.6090e-03, PNorm = 95.4597, GNorm = 0.0755, lr_0 = 9.6164e-04
Validation auc = 0.622403
Epoch 779
Validation auc = 0.621911
Epoch 780
Validation auc = 0.619724
Epoch 781
Validation auc = 0.618084
Epoch 782
Validation auc = 0.617264
Epoch 783
Loss = 6.2255e-02, PNorm = 95.4995, GNorm = 0.5799, lr_0 = 9.6139e-04
Validation auc = 0.614914
Epoch 784
Validation auc = 0.615406
Epoch 785
Validation auc = 0.634430
Epoch 786
Validation auc = 0.659469
Epoch 787
Loss = 1.0015e-01, PNorm = 95.5882, GNorm = 0.6200, lr_0 = 9.6117e-04
Loss = 2.6691e-04, PNorm = 95.6114, GNorm = 0.0083, lr_0 = 9.6115e-04
Validation auc = 0.662858
Epoch 788
Validation auc = 0.679915
Epoch 789
Validation auc = 0.671222
Epoch 790
Validation auc = 0.680024
Epoch 791
Validation auc = 0.687896
Epoch 792
Loss = 4.8426e-02, PNorm = 95.9660, GNorm = 0.3994, lr_0 = 9.6093e-04
Validation auc = 0.692489
Epoch 793
Validation auc = 0.695769
Epoch 794
Validation auc = 0.699377
Epoch 795
Validation auc = 0.702329
Epoch 796
Validation auc = 0.705664
Epoch 797
Loss = 5.7117e-02, PNorm = 96.2817, GNorm = 1.6563, lr_0 = 9.6067e-04
Validation auc = 0.712060
Epoch 798
Validation auc = 0.715777
Epoch 799
Validation auc = 0.718456
Epoch 800
Validation auc = 0.721026
Epoch 801
Loss = 3.0263e-02, PNorm = 96.4340, GNorm = 0.0595, lr_0 = 9.6045e-04
Loss = 1.1916e-02, PNorm = 96.4431, GNorm = 0.2950, lr_0 = 9.6043e-04
Validation auc = 0.711349
Epoch 802
Validation auc = 0.705445
Epoch 803
Validation auc = 0.698830
Epoch 804
Validation auc = 0.693746
Epoch 805
Validation auc = 0.694621
Epoch 806
Loss = 4.1922e-02, PNorm = 96.5604, GNorm = 0.8194, lr_0 = 9.6019e-04
Loss = 4.2357e-04, PNorm = 96.5675, GNorm = 0.0201, lr_0 = 9.6018e-04
Validation auc = 0.696425
Epoch 807
Validation auc = 0.695714
Epoch 808
Validation auc = 0.696917
Epoch 809
Validation auc = 0.697463
Epoch 810
Validation auc = 0.698447
Epoch 811
Loss = 5.1698e-03, PNorm = 96.6477, GNorm = 0.3414, lr_0 = 9.5996e-04
Validation auc = 0.698393
Epoch 812
Validation auc = 0.699650
Epoch 813
Validation auc = 0.698010
Epoch 814
Validation auc = 0.703368
Epoch 815
Validation auc = 0.701618
Epoch 816
Loss = 2.6089e-03, PNorm = 96.6912, GNorm = 0.1145, lr_0 = 9.5970e-04
Validation auc = 0.699869
Epoch 817
Validation auc = 0.700142
Epoch 818
Validation auc = 0.699103
Epoch 819
Validation auc = 0.696971
Epoch 820
Loss = 1.8901e-02, PNorm = 96.7121, GNorm = 1.5027, lr_0 = 9.5948e-04
Loss = 2.5597e-04, PNorm = 96.7137, GNorm = 0.0075, lr_0 = 9.5946e-04
Validation auc = 0.695714
Epoch 821
Validation auc = 0.696097
Epoch 822
Validation auc = 0.696425
Epoch 823
Validation auc = 0.696425
Epoch 824
Validation auc = 0.694183
Epoch 825
Loss = 8.6712e-03, PNorm = 96.7483, GNorm = 0.8111, lr_0 = 9.5924e-04
Validation auc = 0.701126
Epoch 826
Validation auc = 0.707413
Epoch 827
Validation auc = 0.709162
Epoch 828
Validation auc = 0.711896
Epoch 829
Validation auc = 0.712607
Epoch 830
Loss = 3.6712e-02, PNorm = 96.8462, GNorm = 0.6394, lr_0 = 9.5899e-04
Validation auc = 0.706320
Epoch 831
Validation auc = 0.702110
Epoch 832
Validation auc = 0.695823
Epoch 833
Validation auc = 0.692871
Epoch 834
Loss = 5.9656e-02, PNorm = 96.9642, GNorm = 0.9252, lr_0 = 9.5877e-04
Loss = 4.4517e-03, PNorm = 96.9716, GNorm = 0.1168, lr_0 = 9.5875e-04
Validation auc = 0.690192
Epoch 835
Validation auc = 0.688662
Epoch 836
Validation auc = 0.686202
Epoch 837
Validation auc = 0.682867
Epoch 838
Validation auc = 0.679313
Epoch 839
Loss = 4.3972e-02, PNorm = 97.0593, GNorm = 2.7327, lr_0 = 9.5851e-04
Loss = 3.3910e-03, PNorm = 97.0652, GNorm = 0.1183, lr_0 = 9.5849e-04
Validation auc = 0.672698
Epoch 840
Validation auc = 0.667396
Epoch 841
Validation auc = 0.670840
Epoch 842
Validation auc = 0.671824
Epoch 843
Validation auc = 0.677728
Epoch 844
Loss = 1.0536e-02, PNorm = 97.1401, GNorm = 0.7465, lr_0 = 9.5827e-04
Validation auc = 0.691832
Epoch 845
Validation auc = 0.684671
Epoch 846
Validation auc = 0.670074
Epoch 847
Validation auc = 0.671222
Epoch 848
Validation auc = 0.679532
Epoch 849
Loss = 1.2325e-01, PNorm = 97.4295, GNorm = 2.1795, lr_0 = 9.5802e-04
Validation auc = 0.660343
Epoch 850
Validation auc = 0.647496
Epoch 851
Validation auc = 0.641865
Epoch 852
Validation auc = 0.639897
Epoch 853
Loss = 1.0783e-01, PNorm = 97.6824, GNorm = 0.9780, lr_0 = 9.5780e-04
Loss = 1.9741e-02, PNorm = 97.6967, GNorm = 0.2897, lr_0 = 9.5778e-04
Validation auc = 0.644052
Epoch 854
Validation auc = 0.648590
Epoch 855
Validation auc = 0.651104
Epoch 856
Validation auc = 0.654439
Epoch 857
Validation auc = 0.658375
Epoch 858
Loss = 4.6347e-02, PNorm = 97.8548, GNorm = 0.0632, lr_0 = 9.5754e-04
Validation auc = 0.663569
Epoch 859
Validation auc = 0.666029
Epoch 860
Validation auc = 0.668817
Epoch 861
Validation auc = 0.669637
Epoch 862
Validation auc = 0.669746
Epoch 863
Loss = 2.3756e-03, PNorm = 97.9718, GNorm = 0.0329, lr_0 = 9.5730e-04
Validation auc = 0.671496
Epoch 864
Validation auc = 0.663733
Epoch 865
Validation auc = 0.660343
Epoch 866
Validation auc = 0.656243
Epoch 867
Loss = 8.0461e-03, PNorm = 98.0389, GNorm = 0.6267, lr_0 = 9.5708e-04
Loss = 2.8522e-03, PNorm = 98.0423, GNorm = 0.1131, lr_0 = 9.5707e-04
Validation auc = 0.653674
Epoch 868
Validation auc = 0.649191
Epoch 869
Validation auc = 0.645419
Epoch 870
Validation auc = 0.642685
Epoch 871
Validation auc = 0.640772
Epoch 872
Loss = 1.4888e-02, PNorm = 98.0958, GNorm = 0.0539, lr_0 = 9.5683e-04
Loss = 1.0727e-03, PNorm = 98.0990, GNorm = 0.0305, lr_0 = 9.5681e-04
Validation auc = 0.640335
Epoch 873
Validation auc = 0.639132
Epoch 874
Validation auc = 0.642412
Epoch 875
Validation auc = 0.642849
Epoch 876
Validation auc = 0.638038
Epoch 877
Loss = 2.4869e-03, PNorm = 98.1386, GNorm = 0.1373, lr_0 = 9.5659e-04
Validation auc = 0.634048
Epoch 878
Validation auc = 0.605292
Epoch 879
Validation auc = 0.592882
Epoch 880
Validation auc = 0.599825
Epoch 881
Validation auc = 0.608845
Epoch 882
Loss = 3.0653e-02, PNorm = 98.3975, GNorm = 1.3734, lr_0 = 9.5634e-04
Validation auc = 0.616827
Epoch 883
Validation auc = 0.626777
Epoch 884
Validation auc = 0.638585
Epoch 885
Validation auc = 0.650284
Epoch 886
Loss = 1.0872e-01, PNorm = 98.6330, GNorm = 2.1531, lr_0 = 9.5612e-04
Loss = 3.1575e-02, PNorm = 98.6478, GNorm = 1.0239, lr_0 = 9.5610e-04
Validation auc = 0.652362
Epoch 887
Validation auc = 0.647824
Epoch 888
Validation auc = 0.642795
Epoch 889
Validation auc = 0.640280
Epoch 890
Validation auc = 0.644271
Epoch 891
Loss = 4.8829e-02, PNorm = 98.8214, GNorm = 0.6904, lr_0 = 9.5586e-04
Validation auc = 0.647223
Epoch 892
Validation auc = 0.645419
Epoch 893
Validation auc = 0.641865
Epoch 894
Validation auc = 0.640389
Epoch 895
Validation auc = 0.638640
Epoch 896
Loss = 2.5924e-03, PNorm = 98.9326, GNorm = 0.0439, lr_0 = 9.5563e-04
Validation auc = 0.637328
Epoch 897
Validation auc = 0.639733
Epoch 898
Validation auc = 0.641701
Epoch 899
Validation auc = 0.642631
Epoch 900
Loss = 3.4939e-03, PNorm = 98.9932, GNorm = 0.0562, lr_0 = 9.5541e-04
Loss = 1.1251e-03, PNorm = 98.9974, GNorm = 0.0481, lr_0 = 9.5539e-04
Validation auc = 0.643560
Epoch 901
Validation auc = 0.643505
Epoch 902
Validation auc = 0.646075
Epoch 903
Validation auc = 0.649847
Epoch 904
Validation auc = 0.653182
Epoch 905
Loss = 1.1779e-02, PNorm = 99.0439, GNorm = 0.0429, lr_0 = 9.5515e-04
Loss = 1.9797e-04, PNorm = 99.0471, GNorm = 0.0102, lr_0 = 9.5513e-04
Validation auc = 0.653182
Epoch 906
Validation auc = 0.654002
Epoch 907
Validation auc = 0.664170
Epoch 908
Validation auc = 0.680188
Epoch 909
Validation auc = 0.670074
Epoch 910
Loss = 9.3946e-02, PNorm = 99.1637, GNorm = 1.0036, lr_0 = 9.5491e-04
Validation auc = 0.637437
Epoch 911
Validation auc = 0.618139
Epoch 912
Validation auc = 0.618194
Epoch 913
Validation auc = 0.622130
Epoch 914
Validation auc = 0.635524
Epoch 915
Loss = 2.4254e-02, PNorm = 99.4664, GNorm = 0.3571, lr_0 = 9.5466e-04
Validation auc = 0.643396
Epoch 916
Validation auc = 0.652963
Epoch 917
Validation auc = 0.668762
Epoch 918
Validation auc = 0.682757
Epoch 919
Loss = 2.6171e-02, PNorm = 99.6729, GNorm = 0.4374, lr_0 = 9.5444e-04
Loss = 2.5132e-03, PNorm = 99.6859, GNorm = 0.0553, lr_0 = 9.5442e-04
Validation auc = 0.692817
Epoch 920
Validation auc = 0.685382
Epoch 921
Validation auc = 0.677291
Epoch 922
Validation auc = 0.661983
Epoch 923
Validation auc = 0.647442
Epoch 924
Loss = 2.5108e-02, PNorm = 99.8418, GNorm = 0.5303, lr_0 = 9.5419e-04
Validation auc = 0.637054
Epoch 925
Validation auc = 0.628143
Epoch 926
Validation auc = 0.621365
Epoch 927
Validation auc = 0.618139
Epoch 928
Validation auc = 0.615952
Epoch 929
Loss = 1.2705e-01, PNorm = 99.9905, GNorm = 1.0434, lr_0 = 9.5395e-04
Validation auc = 0.614039
Epoch 930
Validation auc = 0.620326
Epoch 931
Validation auc = 0.631150
Epoch 932
Validation auc = 0.637218
Epoch 933
Loss = 3.1237e-02, PNorm = 100.1021, GNorm = 0.5758, lr_0 = 9.5371e-04
Validation auc = 0.639132
Epoch 934
Validation auc = 0.640827
Epoch 935
Validation auc = 0.640608
Epoch 936
Validation auc = 0.641756
Epoch 937
Validation auc = 0.645473
Epoch 938
Loss = 1.4348e-02, PNorm = 100.2237, GNorm = 0.4308, lr_0 = 9.5348e-04
Loss = 3.6701e-03, PNorm = 100.2318, GNorm = 0.0742, lr_0 = 9.5346e-04
Validation auc = 0.647824
Epoch 939
Validation auc = 0.653127
Epoch 940
Validation auc = 0.655587
Epoch 941
Validation auc = 0.656735
Epoch 942
Validation auc = 0.658321
Epoch 943
Loss = 9.1606e-03, PNorm = 100.3124, GNorm = 0.1673, lr_0 = 9.5324e-04
Validation auc = 0.658649
Epoch 944
Validation auc = 0.659086
Epoch 945
Validation auc = 0.659523
Epoch 946
Validation auc = 0.659961
Epoch 947
Validation auc = 0.660343
Epoch 948
Loss = 1.7208e-01, PNorm = 100.3960, GNorm = 0.8072, lr_0 = 9.5299e-04
Validation auc = 0.659523
Epoch 949
Validation auc = 0.662202
Epoch 950
Validation auc = 0.663678
Epoch 951
Validation auc = 0.660507
Epoch 952
Loss = 3.5398e-03, PNorm = 100.4263, GNorm = 0.1171, lr_0 = 9.5277e-04
Loss = 7.6723e-04, PNorm = 100.4310, GNorm = 0.0211, lr_0 = 9.5275e-04
Validation auc = 0.658703
Epoch 953
Validation auc = 0.655587
Epoch 954
Validation auc = 0.654166
Epoch 955
Validation auc = 0.653619
Epoch 956
Validation auc = 0.652580
Epoch 957
Loss = 1.4479e-03, PNorm = 100.4927, GNorm = 0.0161, lr_0 = 9.5251e-04
Loss = 1.6689e-05, PNorm = 100.4959, GNorm = 0.0006, lr_0 = 9.5250e-04
Validation auc = 0.651651
Epoch 958
Validation auc = 0.650940
Epoch 959
Validation auc = 0.650558
Epoch 960
Validation auc = 0.650230
Epoch 961
Validation auc = 0.649519
Epoch 962
Loss = 2.3905e-03, PNorm = 100.5230, GNorm = 0.0519, lr_0 = 9.5228e-04
Validation auc = 0.648863
Epoch 963
Validation auc = 0.648644
Epoch 964
Validation auc = 0.648098
Epoch 965
Validation auc = 0.647332
Epoch 966
Loss = 4.5633e-03, PNorm = 100.5463, GNorm = 0.1551, lr_0 = 9.5204e-04
Validation auc = 0.647879
Epoch 967
Validation auc = 0.647606
Epoch 968
Validation auc = 0.647770
Epoch 969
Validation auc = 0.647004
Epoch 970
Validation auc = 0.647496
Epoch 971
Loss = 4.7682e-02, PNorm = 100.5741, GNorm = 0.0143, lr_0 = 9.5180e-04
Loss = 7.4352e-05, PNorm = 100.5749, GNorm = 0.0031, lr_0 = 9.5179e-04
Validation auc = 0.647059
Epoch 972
Validation auc = 0.646949
Epoch 973
Validation auc = 0.646676
Epoch 974
Validation auc = 0.646731
Epoch 975
Validation auc = 0.645747
Epoch 976
Loss = 1.2283e-03, PNorm = 100.5886, GNorm = 0.0275, lr_0 = 9.5157e-04
Validation auc = 0.644435
Epoch 977
Validation auc = 0.644271
Epoch 978
Validation auc = 0.643997
Epoch 979
Validation auc = 0.643615
Epoch 980
Validation auc = 0.643833
Epoch 981
Loss = 4.7718e-04, PNorm = 100.6109, GNorm = 0.0098, lr_0 = 9.5132e-04
Validation auc = 0.644763
Epoch 982
Validation auc = 0.646676
Epoch 983
Validation auc = 0.647824
Epoch 984
Validation auc = 0.652307
Epoch 985
Loss = 4.9539e-02, PNorm = 100.6435, GNorm = 1.2819, lr_0 = 9.5110e-04
Loss = 9.3215e-04, PNorm = 100.6453, GNorm = 0.0271, lr_0 = 9.5108e-04
Validation auc = 0.654931
Epoch 986
Validation auc = 0.658266
Epoch 987
Validation auc = 0.657719
Epoch 988
Validation auc = 0.655532
Epoch 989
Validation auc = 0.653674
Epoch 990
Loss = 1.7137e-02, PNorm = 100.7027, GNorm = 0.0225, lr_0 = 9.5084e-04
Loss = 2.0146e-05, PNorm = 100.7074, GNorm = 0.0011, lr_0 = 9.5083e-04
Validation auc = 0.653346
Epoch 991
Validation auc = 0.652526
Epoch 992
Validation auc = 0.652908
Epoch 993
Validation auc = 0.652963
Epoch 994
Validation auc = 0.653728
Epoch 995
Loss = 4.4943e-03, PNorm = 100.7622, GNorm = 0.1485, lr_0 = 9.5061e-04
Validation auc = 0.653892
Epoch 996
Validation auc = 0.654494
Epoch 997
Validation auc = 0.656353
Epoch 998
Validation auc = 0.657555
Epoch 999
Loss = 1.8340e-02, PNorm = 100.8039, GNorm = 0.0005, lr_0 = 9.5037e-04
Validation auc = 0.657938
Epoch 1000
Validation auc = 0.657993
Epoch 1001
Validation auc = 0.654330
Epoch 1002
Validation auc = 0.653510
Epoch 1003
Validation auc = 0.660234
Epoch 1004
Loss = 1.7536e-03, PNorm = 100.8571, GNorm = 0.0143, lr_0 = 9.5014e-04
Loss = 1.9692e-04, PNorm = 100.8801, GNorm = 0.0089, lr_0 = 9.5012e-04
Validation auc = 0.666302
Epoch 1005
Validation auc = 0.671550
Epoch 1006
Validation auc = 0.663405
Epoch 1007
Validation auc = 0.664771
Epoch 1008
Validation auc = 0.660617
Epoch 1009
Loss = 7.3627e-02, PNorm = 101.3205, GNorm = 0.8403, lr_0 = 9.4990e-04
Validation auc = 0.661382
Epoch 1010
Validation auc = 0.671714
Epoch 1011
Validation auc = 0.671004
Epoch 1012
Validation auc = 0.665154
Epoch 1013
Validation auc = 0.653674
Epoch 1014
Loss = 1.1654e-02, PNorm = 101.7665, GNorm = 0.2946, lr_0 = 9.4965e-04
Validation auc = 0.632681
Epoch 1015
Validation auc = 0.621146
Epoch 1016
Validation auc = 0.621392
Epoch 1017
Validation auc = 0.627542
Epoch 1018
Loss = 6.9519e-02, PNorm = 102.0238, GNorm = 0.2594, lr_0 = 9.4943e-04
Loss = 7.4729e-03, PNorm = 102.0389, GNorm = 0.3070, lr_0 = 9.4941e-04
Validation auc = 0.633993
Epoch 1019
Validation auc = 0.637601
Epoch 1020
Validation auc = 0.644544
Epoch 1021
Validation auc = 0.647606
Epoch 1022
Validation auc = 0.653892
Epoch 1023
Loss = 2.7047e-02, PNorm = 102.1859, GNorm = 0.9715, lr_0 = 9.4918e-04
Loss = 4.1943e-03, PNorm = 102.1936, GNorm = 0.1534, lr_0 = 9.4916e-04
Validation auc = 0.657282
Epoch 1024
Validation auc = 0.665045
Epoch 1025
Validation auc = 0.671660
Epoch 1026
Validation auc = 0.675760
Epoch 1027
Validation auc = 0.681664
Epoch 1028
Loss = 2.7034e-03, PNorm = 102.2810, GNorm = 0.0834, lr_0 = 9.4894e-04
Validation auc = 0.688388
Epoch 1029
Validation auc = 0.691176
Epoch 1030
Validation auc = 0.686584
Epoch 1031
Validation auc = 0.681555
Epoch 1032
Validation auc = 0.680953
Epoch 1033
Loss = 3.9330e-03, PNorm = 102.3626, GNorm = 0.0651, lr_0 = 9.4869e-04
Validation auc = 0.680680
Epoch 1034
Validation auc = 0.674721
Epoch 1035
Validation auc = 0.669200
Epoch 1036
Validation auc = 0.667833
Epoch 1037
Loss = 3.3021e-03, PNorm = 102.4218, GNorm = 0.0642, lr_0 = 9.4847e-04
Loss = 4.1649e-04, PNorm = 102.4269, GNorm = 0.0110, lr_0 = 9.4845e-04
Validation auc = 0.665537
Epoch 1038
Validation auc = 0.663733
Epoch 1039
Validation auc = 0.661491
Epoch 1040
Validation auc = 0.660179
Epoch 1041
Validation auc = 0.659961
Epoch 1042
Loss = 2.9462e-03, PNorm = 102.4772, GNorm = 0.0753, lr_0 = 9.4823e-04
Validation auc = 0.658321
Epoch 1043
Validation auc = 0.658867
Epoch 1044
Validation auc = 0.660562
Epoch 1045
Validation auc = 0.663077
Epoch 1046
Validation auc = 0.658485
Epoch 1047
Loss = 1.4146e-03, PNorm = 102.5224, GNorm = 0.0298, lr_0 = 9.4798e-04
Validation auc = 0.654384
Epoch 1048
Validation auc = 0.699923
Epoch 1049
Validation auc = 0.724743
Epoch 1050
Validation auc = 0.731577
Epoch 1051
Loss = 9.0005e-03, PNorm = 102.5997, GNorm = 0.1111, lr_0 = 9.4776e-04
Loss = 1.1682e-03, PNorm = 102.6066, GNorm = 0.0323, lr_0 = 9.4775e-04
Validation auc = 0.734091
Epoch 1052
Validation auc = 0.738192
Epoch 1053
Validation auc = 0.739285
Epoch 1054
Validation auc = 0.740706
Epoch 1055
Validation auc = 0.736059
Epoch 1056
Loss = 2.3901e-03, PNorm = 102.6870, GNorm = 0.0680, lr_0 = 9.4751e-04
Loss = 7.0658e-04, PNorm = 102.6928, GNorm = 0.0225, lr_0 = 9.4749e-04
Validation auc = 0.729007
Epoch 1057
Validation auc = 0.721518
Epoch 1058
Validation auc = 0.713044
Epoch 1059
Validation auc = 0.705609
Epoch 1060
Validation auc = 0.698447
Epoch 1061
Loss = 1.3315e-01, PNorm = 102.7589, GNorm = 0.8841, lr_0 = 9.4728e-04
Validation auc = 0.694074
Epoch 1062
Validation auc = 0.692106
Epoch 1063
Validation auc = 0.691668
Epoch 1064
Validation auc = 0.691340
Epoch 1065
Validation auc = 0.690739
Epoch 1066
Loss = 6.0477e-04, PNorm = 102.8100, GNorm = 0.0107, lr_0 = 9.4702e-04
Validation auc = 0.693145
Epoch 1067
Validation auc = 0.696862
Epoch 1068
Validation auc = 0.696479
Epoch 1069
Validation auc = 0.691395
Epoch 1070
Loss = 1.0129e-01, PNorm = 102.8733, GNorm = 0.6396, lr_0 = 9.4681e-04
Loss = 1.4777e-02, PNorm = 102.8811, GNorm = 0.2462, lr_0 = 9.4679e-04
Validation auc = 0.684671
Epoch 1071
Validation auc = 0.677783
Epoch 1072
Validation auc = 0.679259
Epoch 1073
Validation auc = 0.681227
Epoch 1074
Validation auc = 0.683250
Epoch 1075
Loss = 2.6792e-02, PNorm = 102.9853, GNorm = 0.2242, lr_0 = 9.4657e-04
Validation auc = 0.685928
Epoch 1076
Validation auc = 0.689919
Epoch 1077
Validation auc = 0.696534
Epoch 1078
Validation auc = 0.701946
Epoch 1079
Validation auc = 0.704406
Epoch 1080
Loss = 2.4235e-03, PNorm = 103.1021, GNorm = 0.0342, lr_0 = 9.4632e-04
Validation auc = 0.703532
Epoch 1081
Validation auc = 0.704242
Epoch 1082
Validation auc = 0.705554
Epoch 1083
Validation auc = 0.707085
Epoch 1084
Loss = 4.6369e-02, PNorm = 103.1922, GNorm = 0.0610, lr_0 = 9.4610e-04
Loss = 2.1391e-03, PNorm = 103.1978, GNorm = 0.1302, lr_0 = 9.4608e-04
Validation auc = 0.704734
Epoch 1085
Validation auc = 0.697627
Epoch 1086
Validation auc = 0.675268
Epoch 1087
Validation auc = 0.670020
Epoch 1088
Validation auc = 0.670566
Epoch 1089
Loss = 4.3109e-02, PNorm = 103.3452, GNorm = 1.3830, lr_0 = 9.4585e-04
Loss = 9.2254e-02, PNorm = 103.3596, GNorm = 4.1384, lr_0 = 9.4583e-04
Validation auc = 0.663951
Epoch 1090
Validation auc = 0.651651
Epoch 1091
Validation auc = 0.646785
Epoch 1092
Validation auc = 0.645528
Epoch 1093
Validation auc = 0.641756
Epoch 1094
Loss = 1.8900e-02, PNorm = 103.5653, GNorm = 0.3382, lr_0 = 9.4561e-04
Validation auc = 0.636180
Epoch 1095
Validation auc = 0.632790
Epoch 1096
Validation auc = 0.628909
Epoch 1097
Validation auc = 0.626503
Epoch 1098
Validation auc = 0.620216
Epoch 1099
Loss = 2.3499e-03, PNorm = 103.7408, GNorm = 0.0537, lr_0 = 9.4536e-04
Validation auc = 0.611141
Epoch 1100
Validation auc = 0.606659
Epoch 1101
Validation auc = 0.610212
Epoch 1102
Validation auc = 0.617866
Epoch 1103
Loss = 9.8468e-04, PNorm = 103.8365, GNorm = 0.0154, lr_0 = 9.4515e-04
Loss = 8.0952e-04, PNorm = 103.8432, GNorm = 0.0240, lr_0 = 9.4513e-04
Validation auc = 0.623387
Epoch 1104
Validation auc = 0.623551
Epoch 1105
Validation auc = 0.626503
Epoch 1106
Validation auc = 0.626995
Epoch 1107
Validation auc = 0.625191
Epoch 1108
Loss = 1.7344e-02, PNorm = 103.8718, GNorm = 0.1667, lr_0 = 9.4489e-04
Validation auc = 0.624481
Epoch 1109
Validation auc = 0.624699
Epoch 1110
Validation auc = 0.625137
Epoch 1111
Validation auc = 0.626558
Epoch 1112
Validation auc = 0.632298
Epoch 1113
Loss = 3.4824e-03, PNorm = 103.9266, GNorm = 0.0868, lr_0 = 9.4466e-04
Validation auc = 0.634649
Epoch 1114
Validation auc = 0.636945
Epoch 1115
Validation auc = 0.639351
Epoch 1116
Validation auc = 0.641155
Epoch 1117
Loss = 1.4558e-03, PNorm = 103.9742, GNorm = 0.0201, lr_0 = 9.4444e-04
Loss = 4.7773e-03, PNorm = 103.9782, GNorm = 0.1241, lr_0 = 9.4443e-04
Validation auc = 0.643341
Epoch 1118
Validation auc = 0.644981
Epoch 1119
Validation auc = 0.646731
Epoch 1120
Validation auc = 0.647387
Epoch 1121
Validation auc = 0.649355
Epoch 1122
Loss = 8.2454e-02, PNorm = 104.0129, GNorm = 0.9613, lr_0 = 9.4419e-04
Loss = 1.1581e-03, PNorm = 104.0139, GNorm = 0.0336, lr_0 = 9.4417e-04
Validation auc = 0.651542
Epoch 1123
Validation auc = 0.654384
Epoch 1124
Validation auc = 0.658157
Epoch 1125
Validation auc = 0.660507
Epoch 1126
Validation auc = 0.659961
Epoch 1127
Loss = 1.3007e-03, PNorm = 104.0717, GNorm = 0.0244, lr_0 = 9.4396e-04
Validation auc = 0.658594
Epoch 1128
Validation auc = 0.657337
Epoch 1129
Validation auc = 0.655860
Epoch 1130
Validation auc = 0.654822
Epoch 1131
Validation auc = 0.653564
Epoch 1132
Loss = 1.6891e-03, PNorm = 104.1351, GNorm = 0.0311, lr_0 = 9.4371e-04
Validation auc = 0.653838
Epoch 1133
Validation auc = 0.652963
Epoch 1134
Validation auc = 0.660507
Epoch 1135
Validation auc = 0.664771
Epoch 1136
Loss = 9.8540e-03, PNorm = 104.1303, GNorm = 0.0344, lr_0 = 9.4349e-04
Loss = 1.2908e-03, PNorm = 104.1314, GNorm = 0.0367, lr_0 = 9.4347e-04
Validation auc = 0.671113
Epoch 1137
Validation auc = 0.674831
Epoch 1138
Validation auc = 0.678220
Epoch 1139
Validation auc = 0.679313
Epoch 1140
Validation auc = 0.679423
Epoch 1141
Loss = 3.9303e-03, PNorm = 104.1668, GNorm = 0.0541, lr_0 = 9.4324e-04
Validation auc = 0.678712
Epoch 1142
Validation auc = 0.676963
Epoch 1143
Validation auc = 0.674393
Epoch 1144
Validation auc = 0.672644
Epoch 1145
Validation auc = 0.671222
Epoch 1146
Loss = 5.6807e-04, PNorm = 104.2145, GNorm = 0.0124, lr_0 = 9.4300e-04
Validation auc = 0.670348
Epoch 1147
Validation auc = 0.669801
Epoch 1148
Validation auc = 0.667669
Epoch 1149
Validation auc = 0.666849
Epoch 1150
Loss = 1.1953e-03, PNorm = 104.2552, GNorm = 0.0110, lr_0 = 9.4279e-04
Loss = 1.8043e-03, PNorm = 104.2584, GNorm = 0.0491, lr_0 = 9.4277e-04
Validation auc = 0.664334
Epoch 1151
Validation auc = 0.662530
Epoch 1152
Validation auc = 0.659851
Epoch 1153
Validation auc = 0.655587
Epoch 1154
Validation auc = 0.653182
Epoch 1155
Loss = 1.4591e-03, PNorm = 104.2974, GNorm = 0.0324, lr_0 = 9.4253e-04
Loss = 6.0395e-05, PNorm = 104.2991, GNorm = 0.0020, lr_0 = 9.4252e-04
Validation auc = 0.650667
Epoch 1156
Validation auc = 0.650175
Epoch 1157
Validation auc = 0.648043
Epoch 1158
Validation auc = 0.646676
Epoch 1159
Validation auc = 0.645036
Epoch 1160
Loss = 1.6134e-02, PNorm = 104.3377, GNorm = 0.5253, lr_0 = 9.4230e-04
Validation auc = 0.642357
Epoch 1161
Validation auc = 0.639460
Epoch 1162
Validation auc = 0.637601
Epoch 1163
Validation auc = 0.635797
Epoch 1164
Validation auc = 0.634813
Epoch 1165
Loss = 2.0518e-03, PNorm = 104.3998, GNorm = 0.0481, lr_0 = 9.4205e-04
Validation auc = 0.634048
Epoch 1166
Validation auc = 0.633173
Epoch 1167
Validation auc = 0.632845
Epoch 1168
Validation auc = 0.632626
Epoch 1169
Loss = 2.3007e-02, PNorm = 104.4262, GNorm = 2.9792, lr_0 = 9.4183e-04
Loss = 3.7905e-05, PNorm = 104.4277, GNorm = 0.0015, lr_0 = 9.4182e-04
Validation auc = 0.638913
Epoch 1170
Validation auc = 0.644489
Epoch 1171
Validation auc = 0.646895
Epoch 1172
Validation auc = 0.649082
Epoch 1173
Validation auc = 0.650503
Epoch 1174
Loss = 7.4808e-04, PNorm = 104.4523, GNorm = 0.0344, lr_0 = 9.4158e-04
Validation auc = 0.652088
Epoch 1175
Validation auc = 0.652963
Epoch 1176
Validation auc = 0.653400
Epoch 1177
Validation auc = 0.649792
Epoch 1178
Validation auc = 0.649027
Epoch 1179
Loss = 1.0481e-03, PNorm = 104.4762, GNorm = 0.0835, lr_0 = 9.4135e-04
Validation auc = 0.654275
Epoch 1180
Validation auc = 0.664990
Epoch 1181
Validation auc = 0.660617
Epoch 1182
Validation auc = 0.667942
Epoch 1183
Loss = 1.5881e-01, PNorm = 104.5722, GNorm = 2.6170, lr_0 = 9.4112e-04
Validation auc = 0.693035
Epoch 1184
Validation auc = 0.699923
Epoch 1185
Validation auc = 0.697081
Epoch 1186
Validation auc = 0.662093
Epoch 1187
Validation auc = 0.597201
Epoch 1188
Loss = 1.7072e-01, PNorm = 104.8710, GNorm = 1.5629, lr_0 = 9.4088e-04
Loss = 6.8835e-02, PNorm = 104.9099, GNorm = 2.2248, lr_0 = 9.4087e-04
Validation auc = 0.660070
Epoch 1189
Validation auc = 0.695441
Epoch 1190
Validation auc = 0.704024
Epoch 1191
Validation auc = 0.699869
Epoch 1192
Validation auc = 0.685382
Epoch 1193
Loss = 7.2165e-02, PNorm = 105.3982, GNorm = 1.7903, lr_0 = 9.4065e-04
Validation auc = 0.674503
Epoch 1194
Validation auc = 0.665099
Epoch 1195
Validation auc = 0.655259
Epoch 1196
Validation auc = 0.668325
Epoch 1197
Validation auc = 0.698010
Epoch 1198
Loss = 3.3314e-02, PNorm = 105.8105, GNorm = 0.7263, lr_0 = 9.4040e-04
Validation auc = 0.704406
Epoch 1199
Validation auc = 0.695386
Epoch 1200
Validation auc = 0.682101
Epoch 1201
Validation auc = 0.674831
Epoch 1202
Loss = 2.3728e-02, PNorm = 106.1283, GNorm = 0.5093, lr_0 = 9.4018e-04
Loss = 1.2828e-02, PNorm = 106.1459, GNorm = 0.2721, lr_0 = 9.4016e-04
Validation auc = 0.668544
Epoch 1203
Validation auc = 0.669364
Epoch 1204
Validation auc = 0.671878
Epoch 1205
Validation auc = 0.678165
Epoch 1206
Validation auc = 0.700798
Epoch 1207
Loss = 8.1445e-03, PNorm = 106.3396, GNorm = 0.5687, lr_0 = 9.3993e-04
Loss = 1.8698e-03, PNorm = 106.3490, GNorm = 0.0487, lr_0 = 9.3991e-04
Validation auc = 0.704461
Epoch 1208
Validation auc = 0.700962
Epoch 1209
Validation auc = 0.694839
Epoch 1210
Validation auc = 0.689318
Epoch 1211
Validation auc = 0.686967
Epoch 1212
Loss = 1.7468e-02, PNorm = 106.4523, GNorm = 0.5150, lr_0 = 9.3970e-04
Validation auc = 0.684616
Epoch 1213
Validation auc = 0.683632
Epoch 1214
Validation auc = 0.681281
Epoch 1215
Validation auc = 0.670129
Epoch 1216
Loss = 2.7629e-02, PNorm = 106.5342, GNorm = 0.0053, lr_0 = 9.3946e-04
Validation auc = 0.661437
Epoch 1217
Validation auc = 0.658157
Epoch 1218
Validation auc = 0.655150
Epoch 1219
Validation auc = 0.650940
Epoch 1220
Validation auc = 0.648699
Epoch 1221
Loss = 2.5311e-03, PNorm = 106.6604, GNorm = 0.0703, lr_0 = 9.3923e-04
Loss = 3.3807e-04, PNorm = 106.6676, GNorm = 0.0095, lr_0 = 9.3922e-04
Validation auc = 0.646129
Epoch 1222
Validation auc = 0.644544
Epoch 1223
Validation auc = 0.643943
Epoch 1224
Validation auc = 0.644107
Epoch 1225
Validation auc = 0.642740
Epoch 1226
Loss = 3.6626e-03, PNorm = 106.7348, GNorm = 0.0953, lr_0 = 9.3900e-04
Validation auc = 0.638804
Epoch 1227
Validation auc = 0.643943
Epoch 1228
Validation auc = 0.648918
Epoch 1229
Validation auc = 0.651706
Epoch 1230
Validation auc = 0.652963
Epoch 1231
Loss = 1.0318e-03, PNorm = 106.8048, GNorm = 0.0256, lr_0 = 9.3875e-04
Validation auc = 0.653291
Epoch 1232
Validation auc = 0.651050
Epoch 1233
Validation auc = 0.649464
Epoch 1234
Validation auc = 0.646020
Epoch 1235
Loss = 2.2425e-02, PNorm = 107.0057, GNorm = 0.1243, lr_0 = 9.3853e-04
Loss = 2.0783e-03, PNorm = 107.0259, GNorm = 0.0475, lr_0 = 9.3852e-04
Validation auc = 0.646895
Epoch 1236
Validation auc = 0.654439
Epoch 1237
Validation auc = 0.660835
Epoch 1238
Validation auc = 0.664881
Epoch 1239
Validation auc = 0.669309
Epoch 1240
Loss = 2.7107e-02, PNorm = 107.2226, GNorm = 0.2549, lr_0 = 9.3828e-04
Loss = 1.8707e-01, PNorm = 107.2353, GNorm = 4.6413, lr_0 = 9.3827e-04
Validation auc = 0.671386
Epoch 1241
Validation auc = 0.671004
Epoch 1242
Validation auc = 0.674284
Epoch 1243
Validation auc = 0.683414
Epoch 1244
Validation auc = 0.684288
Epoch 1245
Loss = 1.6445e-02, PNorm = 107.4415, GNorm = 0.3106, lr_0 = 9.3805e-04
Validation auc = 0.681937
Epoch 1246
Validation auc = 0.684616
Epoch 1247
Validation auc = 0.687623
Epoch 1248
Validation auc = 0.690794
Epoch 1249
Loss = 1.0652e-02, PNorm = 107.6606, GNorm = 0.0423, lr_0 = 9.3782e-04
Validation auc = 0.691504
Epoch 1250
Validation auc = 0.692707
Epoch 1251
Validation auc = 0.693309
Epoch 1252
Validation auc = 0.692161
Epoch 1253
Validation auc = 0.685874
Epoch 1254
Loss = 9.9187e-03, PNorm = 107.7792, GNorm = 1.0433, lr_0 = 9.3758e-04
Loss = 3.8908e-04, PNorm = 107.7866, GNorm = 0.0120, lr_0 = 9.3757e-04
Validation auc = 0.684452
Epoch 1255
Validation auc = 0.689099
Epoch 1256
Validation auc = 0.693855
Epoch 1257
Validation auc = 0.696534
Epoch 1258
Validation auc = 0.702930
Epoch 1259
Loss = 4.0573e-04, PNorm = 107.8478, GNorm = 0.0087, lr_0 = 9.3735e-04
Validation auc = 0.708178
Epoch 1260
Validation auc = 0.712497
Epoch 1261
Validation auc = 0.713591
Epoch 1262
Validation auc = 0.715832
Epoch 1263
Validation auc = 0.718620
Epoch 1264
Loss = 4.4592e-03, PNorm = 107.8984, GNorm = 0.0852, lr_0 = 9.3710e-04
Validation auc = 0.721354
Epoch 1265
Validation auc = 0.720315
Epoch 1266
Validation auc = 0.714465
Epoch 1267
Validation auc = 0.708616
Epoch 1268
Loss = 2.6281e-03, PNorm = 107.9417, GNorm = 0.0623, lr_0 = 9.3689e-04
Loss = 2.6842e-03, PNorm = 107.9449, GNorm = 0.0714, lr_0 = 9.3687e-04
Validation auc = 0.704406
Epoch 1269
Validation auc = 0.702602
Epoch 1270
Validation auc = 0.700251
Epoch 1271
Validation auc = 0.699103
Epoch 1272
Validation auc = 0.697573
Epoch 1273
Loss = 7.6978e-04, PNorm = 107.9846, GNorm = 0.0175, lr_0 = 9.3664e-04
Loss = 2.6537e-04, PNorm = 107.9870, GNorm = 0.0093, lr_0 = 9.3662e-04
Validation auc = 0.696206
Epoch 1274
Validation auc = 0.695331
Epoch 1275
Validation auc = 0.695987
Epoch 1276
Validation auc = 0.696151
Epoch 1277
Validation auc = 0.696862
Epoch 1278
Loss = 5.5961e-04, PNorm = 108.0110, GNorm = 0.0145, lr_0 = 9.3641e-04
Validation auc = 0.696971
Epoch 1279
Validation auc = 0.697463
Epoch 1280
Validation auc = 0.697518
Epoch 1281
Validation auc = 0.697791
Epoch 1282
Validation auc = 0.697190
Epoch 1283
Loss = 8.1601e-04, PNorm = 108.0122, GNorm = 0.0182, lr_0 = 9.3616e-04
Validation auc = 0.697081
Epoch 1284
Validation auc = 0.696971
Epoch 1285
Validation auc = 0.696862
Epoch 1286
Validation auc = 0.696807
Epoch 1287
Loss = 2.6088e-03, PNorm = 108.0242, GNorm = 0.1486, lr_0 = 9.3594e-04
Loss = 5.9410e-04, PNorm = 108.0256, GNorm = 0.0304, lr_0 = 9.3592e-04
Validation auc = 0.696534
Epoch 1288
Validation auc = 0.696425
Epoch 1289
Validation auc = 0.696425
Epoch 1290
Validation auc = 0.696261
Epoch 1291
Validation auc = 0.696261
Epoch 1292
Loss = 8.4564e-05, PNorm = 108.0428, GNorm = 0.0022, lr_0 = 9.3571e-04
Validation auc = 0.696261
Epoch 1293
Validation auc = 0.695987
Epoch 1294
Validation auc = 0.697190
Epoch 1295
Validation auc = 0.699486
Epoch 1296
Validation auc = 0.701782
Epoch 1297
Loss = 2.3790e-03, PNorm = 108.0553, GNorm = 0.1678, lr_0 = 9.3546e-04
Validation auc = 0.703422
Epoch 1298
Validation auc = 0.706265
Epoch 1299
Validation auc = 0.708616
Epoch 1300
Validation auc = 0.711076
Epoch 1301
Loss = 6.4869e-03, PNorm = 108.0732, GNorm = 0.0092, lr_0 = 9.3524e-04
Loss = 4.7521e-05, PNorm = 108.0757, GNorm = 0.0018, lr_0 = 9.3523e-04
Validation auc = 0.711841
Epoch 1302
Validation auc = 0.709545
Epoch 1303
Validation auc = 0.707850
Epoch 1304
Validation auc = 0.705554
Epoch 1305
Validation auc = 0.702384
Epoch 1306
Loss = 1.1051e-03, PNorm = 108.1094, GNorm = 0.0540, lr_0 = 9.3499e-04
Loss = 1.3307e-03, PNorm = 108.1123, GNorm = 0.0354, lr_0 = 9.3498e-04
Validation auc = 0.698994
Epoch 1307
Validation auc = 0.696917
Epoch 1308
Validation auc = 0.694785
Epoch 1309
Validation auc = 0.691997
Epoch 1310
Validation auc = 0.687568
Epoch 1311
Loss = 5.8634e-04, PNorm = 108.1400, GNorm = 0.0117, lr_0 = 9.3476e-04
Validation auc = 0.684015
Epoch 1312
Validation auc = 0.683523
Epoch 1313
Validation auc = 0.683523
Epoch 1314
Validation auc = 0.683414
Epoch 1315
Validation auc = 0.683632
Epoch 1316
Loss = 1.1030e-03, PNorm = 108.1623, GNorm = 0.1103, lr_0 = 9.3451e-04
Validation auc = 0.683960
Epoch 1317
Validation auc = 0.684671
Epoch 1318
Validation auc = 0.685491
Epoch 1319
Validation auc = 0.607752
Epoch 1320
Loss = 4.0775e-01, PNorm = 108.1697, GNorm = 21.7068, lr_0 = 9.3430e-04
Loss = 6.8453e-04, PNorm = 108.1724, GNorm = 0.0352, lr_0 = 9.3428e-04
Validation auc = 0.708725
Epoch 1321
Validation auc = 0.708342
Epoch 1322
Validation auc = 0.704789
Epoch 1323
Validation auc = 0.697627
Epoch 1324
Validation auc = 0.693309
Epoch 1325
Loss = 2.0804e-02, PNorm = 108.3163, GNorm = 0.7205, lr_0 = 9.3407e-04
Validation auc = 0.689154
Epoch 1326
Validation auc = 0.686147
Epoch 1327
Validation auc = 0.684070
Epoch 1328
Validation auc = 0.682429
Epoch 1329
Validation auc = 0.681555
Epoch 1330
Loss = 8.3326e-03, PNorm = 108.4768, GNorm = 0.3423, lr_0 = 9.3382e-04
Validation auc = 0.680953
Epoch 1331
Validation auc = 0.679969
Epoch 1332
Validation auc = 0.680680
Epoch 1333
Validation auc = 0.680243
Epoch 1334
Loss = 2.6669e-03, PNorm = 108.5668, GNorm = 0.2228, lr_0 = 9.3360e-04
Loss = 8.1049e-04, PNorm = 108.5727, GNorm = 0.0743, lr_0 = 9.3359e-04
Validation auc = 0.681281
Epoch 1335
Validation auc = 0.684452
Epoch 1336
Validation auc = 0.694074
Epoch 1337
Validation auc = 0.690575
Epoch 1338
Validation auc = 0.678439
Epoch 1339
Loss = 3.3881e-03, PNorm = 108.7327, GNorm = 0.2620, lr_0 = 9.3336e-04
Loss = 4.6773e-04, PNorm = 108.7450, GNorm = 0.0137, lr_0 = 9.3334e-04
Validation auc = 0.670402
Epoch 1340
Validation auc = 0.667286
Epoch 1341
Validation auc = 0.660890
Epoch 1342
Validation auc = 0.655587
Epoch 1343
Validation auc = 0.646567
Epoch 1344
Loss = 6.6976e-03, PNorm = 108.8509, GNorm = 0.1292, lr_0 = 9.3312e-04
Validation auc = 0.643177
Epoch 1345
Validation auc = 0.644325
Epoch 1346
Validation auc = 0.647988
Epoch 1347
Validation auc = 0.649847
Epoch 1348
Validation auc = 0.651870
Epoch 1349
Loss = 9.1197e-02, PNorm = 109.0013, GNorm = 0.7399, lr_0 = 9.3288e-04
Validation auc = 0.652635
Epoch 1350
Validation auc = 0.659742
Epoch 1351
Validation auc = 0.664170
Epoch 1352
Validation auc = 0.668653
Epoch 1353
Loss = 4.6364e-02, PNorm = 109.0624, GNorm = 1.7361, lr_0 = 9.3266e-04
Loss = 2.4863e-03, PNorm = 109.0654, GNorm = 0.0550, lr_0 = 9.3264e-04
Validation auc = 0.676361
Epoch 1354
Validation auc = 0.678985
Epoch 1355
Validation auc = 0.681445
Epoch 1356
Validation auc = 0.683086
Epoch 1357
Validation auc = 0.684452
Epoch 1358
Loss = 1.3093e-03, PNorm = 109.1121, GNorm = 0.0336, lr_0 = 9.3241e-04
Validation auc = 0.684726
Epoch 1359
Validation auc = 0.684835
Epoch 1360
Validation auc = 0.686202
Epoch 1361
Validation auc = 0.687842
Epoch 1362
Validation auc = 0.686858
Epoch 1363
Loss = 4.2019e-02, PNorm = 109.1397, GNorm = 0.9765, lr_0 = 9.3218e-04
Validation auc = 0.682539
Epoch 1364
Validation auc = 0.679368
Epoch 1365
Validation auc = 0.678493
Epoch 1366
Validation auc = 0.677619
Epoch 1367
Loss = 8.8726e-03, PNorm = 109.1648, GNorm = 0.6788, lr_0 = 9.3197e-04
Loss = 4.2827e-03, PNorm = 109.1669, GNorm = 0.1740, lr_0 = 9.3195e-04
Validation auc = 0.678220
Epoch 1368
Validation auc = 0.678767
Epoch 1369
Validation auc = 0.679641
Epoch 1370
Validation auc = 0.680079
Epoch 1371
Validation auc = 0.679751
Epoch 1372
Loss = 7.8006e-02, PNorm = 109.2030, GNorm = 1.0261, lr_0 = 9.3172e-04
Loss = 4.8491e-04, PNorm = 109.2041, GNorm = 0.0142, lr_0 = 9.3170e-04
Validation auc = 0.681172
Epoch 1373
Validation auc = 0.681391
Epoch 1374
Validation auc = 0.681719
Epoch 1375
Validation auc = 0.683140
Epoch 1376
Validation auc = 0.683632
Epoch 1377
Loss = 2.0340e-02, PNorm = 109.2248, GNorm = 1.1468, lr_0 = 9.3149e-04
Validation auc = 0.683414
Epoch 1378
Validation auc = 0.681773
Epoch 1379
Validation auc = 0.680735
Epoch 1380
Validation auc = 0.679969
Epoch 1381
Validation auc = 0.680461
Epoch 1382
Loss = 4.6453e-04, PNorm = 109.2627, GNorm = 0.0144, lr_0 = 9.3124e-04
Validation auc = 0.680735
Epoch 1383
Validation auc = 0.680735
Epoch 1384
Validation auc = 0.680953
Epoch 1385
Validation auc = 0.681117
Epoch 1386
Loss = 2.3803e-02, PNorm = 109.2914, GNorm = 0.0163, lr_0 = 9.3102e-04
Loss = 3.8667e-03, PNorm = 109.2932, GNorm = 0.3232, lr_0 = 9.3101e-04
Validation auc = 0.680953
Epoch 1387
Validation auc = 0.680789
Epoch 1388
Validation auc = 0.680516
Epoch 1389
Validation auc = 0.680243
Epoch 1390
Validation auc = 0.680188
Epoch 1391
Loss = 2.0389e-03, PNorm = 109.3076, GNorm = 0.0946, lr_0 = 9.3078e-04
Validation auc = 0.679095
Epoch 1392
Validation auc = 0.678712
Epoch 1393
Validation auc = 0.678220
Epoch 1394
Validation auc = 0.677564
Epoch 1395
Validation auc = 0.677564
Epoch 1396
Loss = 2.0082e-01, PNorm = 109.3298, GNorm = 1.0849, lr_0 = 9.3055e-04
Validation auc = 0.676853
Epoch 1397
Validation auc = 0.676471
Epoch 1398
Validation auc = 0.676197
Epoch 1399
Validation auc = 0.675924
Epoch 1400
Loss = 2.3961e-03, PNorm = 109.3398, GNorm = 0.0490, lr_0 = 9.3033e-04
Loss = 3.8110e-04, PNorm = 109.3418, GNorm = 0.0122, lr_0 = 9.3032e-04
Validation auc = 0.675705
Epoch 1401
Validation auc = 0.675815
Epoch 1402
Validation auc = 0.676252
Epoch 1403
Validation auc = 0.676689
Epoch 1404
Validation auc = 0.677072
Epoch 1405
Loss = 2.8679e-02, PNorm = 109.3791, GNorm = 2.0911, lr_0 = 9.3008e-04
Loss = 2.7283e-04, PNorm = 109.3827, GNorm = 0.0095, lr_0 = 9.3007e-04
Validation auc = 0.680680
Epoch 1406
Validation auc = 0.684452
Epoch 1407
Validation auc = 0.682812
Epoch 1408
Validation auc = 0.681336
Epoch 1409
Validation auc = 0.679313
Epoch 1410
Loss = 2.3696e-03, PNorm = 109.4274, GNorm = 0.3133, lr_0 = 9.2985e-04
Validation auc = 0.676525
Epoch 1411
Validation auc = 0.674831
Epoch 1412
Validation auc = 0.673245
Epoch 1413
Validation auc = 0.671714
Epoch 1414
Validation auc = 0.671222
Epoch 1415
Loss = 1.1414e-03, PNorm = 109.4563, GNorm = 0.0399, lr_0 = 9.2961e-04
Validation auc = 0.670238
Epoch 1416
Validation auc = 0.670074
Epoch 1417
Validation auc = 0.669582
Epoch 1418
Validation auc = 0.669254
Epoch 1419
Loss = 4.0237e-04, PNorm = 109.4795, GNorm = 0.0076, lr_0 = 9.2939e-04
Loss = 9.8679e-05, PNorm = 109.4809, GNorm = 0.0039, lr_0 = 9.2938e-04
Validation auc = 0.668434
Epoch 1420
Validation auc = 0.668489
Epoch 1421
Validation auc = 0.668598
Epoch 1422
Validation auc = 0.668817
Epoch 1423
Validation auc = 0.669090
Epoch 1424
Loss = 3.6909e-04, PNorm = 109.4982, GNorm = 0.0080, lr_0 = 9.2914e-04
Validation auc = 0.669254
Epoch 1425
Validation auc = 0.669200
Epoch 1426
Validation auc = 0.668981
Epoch 1427
Validation auc = 0.669145
Epoch 1428
Validation auc = 0.670074
Epoch 1429
Loss = 3.9965e-03, PNorm = 109.4967, GNorm = 0.0945, lr_0 = 9.2891e-04
Validation auc = 0.669856
Epoch 1430
Validation auc = 0.670457
Epoch 1431
Validation auc = 0.669200
Epoch 1432
Validation auc = 0.668544
Epoch 1433
Loss = 1.1373e-02, PNorm = 109.5467, GNorm = 0.0320, lr_0 = 9.2868e-04
Validation auc = 0.669473
Epoch 1434
Validation auc = 0.670566
Epoch 1435
Validation auc = 0.672370
Epoch 1436
Validation auc = 0.673464
Epoch 1437
Validation auc = 0.674557
Epoch 1438
Loss = 6.0295e-03, PNorm = 109.6269, GNorm = 0.0694, lr_0 = 9.2845e-04
Loss = 2.6139e-03, PNorm = 109.6333, GNorm = 0.1006, lr_0 = 9.2844e-04
Validation auc = 0.676689
Epoch 1439
Validation auc = 0.678493
Epoch 1440
Validation auc = 0.680516
Epoch 1441
Validation auc = 0.681992
Epoch 1442
Validation auc = 0.682757
Epoch 1443
Loss = 2.5512e-03, PNorm = 109.7154, GNorm = 0.0344, lr_0 = 9.2822e-04
Validation auc = 0.684179
Epoch 1444
Validation auc = 0.685928
Epoch 1445
Validation auc = 0.686639
Epoch 1446
Validation auc = 0.687022
Epoch 1447
Validation auc = 0.687732
Epoch 1448
Loss = 1.9265e-04, PNorm = 109.7856, GNorm = 0.0062, lr_0 = 9.2798e-04
Validation auc = 0.687787
Epoch 1449
Validation auc = 0.687732
Epoch 1450
Validation auc = 0.687514
Epoch 1451
Validation auc = 0.686366
Epoch 1452
Loss = 5.1494e-03, PNorm = 109.8218, GNorm = 0.6692, lr_0 = 9.2776e-04
Loss = 5.4172e-05, PNorm = 109.8239, GNorm = 0.0026, lr_0 = 9.2775e-04
Validation auc = 0.684288
Epoch 1453
Validation auc = 0.685218
Epoch 1454
Validation auc = 0.685218
Epoch 1455
Validation auc = 0.685163
Epoch 1456
Validation auc = 0.685874
Epoch 1457
Loss = 3.7002e-04, PNorm = 109.8547, GNorm = 0.0075, lr_0 = 9.2752e-04
Loss = 3.1429e-05, PNorm = 109.8565, GNorm = 0.0014, lr_0 = 9.2750e-04
Validation auc = 0.685819
Epoch 1458
Validation auc = 0.686912
Epoch 1459
Validation auc = 0.687459
Epoch 1460
Validation auc = 0.687568
Epoch 1461
Validation auc = 0.687623
Epoch 1462
Loss = 7.5236e-04, PNorm = 109.8803, GNorm = 0.0779, lr_0 = 9.2729e-04
Validation auc = 0.687350
Epoch 1463
Validation auc = 0.686967
Epoch 1464
Validation auc = 0.686639
Epoch 1465
Validation auc = 0.686475
Epoch 1466
Loss = 1.0814e-04, PNorm = 109.8950, GNorm = 0.0002, lr_0 = 9.2706e-04
Validation auc = 0.686202
Epoch 1467
Validation auc = 0.686256
Epoch 1468
Validation auc = 0.686202
Epoch 1469
Validation auc = 0.686803
Epoch 1470
Validation auc = 0.687186
Epoch 1471
Loss = 1.6132e-03, PNorm = 109.9104, GNorm = 0.0029, lr_0 = 9.2683e-04
Loss = 5.2849e-06, PNorm = 109.9121, GNorm = 0.0002, lr_0 = 9.2681e-04
Validation auc = 0.688115
Epoch 1472
Validation auc = 0.676580
Epoch 1473
Validation auc = 0.679532
Epoch 1474
Validation auc = 0.682156
Epoch 1475
Validation auc = 0.683906
Epoch 1476
Loss = 1.3082e-03, PNorm = 109.9759, GNorm = 0.0488, lr_0 = 9.2660e-04
Validation auc = 0.685436
Epoch 1477
Validation auc = 0.689208
Epoch 1478
Validation auc = 0.692106
Epoch 1479
Validation auc = 0.694511
Epoch 1480
Validation auc = 0.695714
Epoch 1481
Loss = 4.0133e-03, PNorm = 110.0913, GNorm = 0.1326, lr_0 = 9.2635e-04
Validation auc = 0.696971
Epoch 1482
Validation auc = 0.696261
Epoch 1483
Validation auc = 0.696315
Epoch 1484
Validation auc = 0.696917
Epoch 1485
Loss = 4.5723e-02, PNorm = 110.1528, GNorm = 1.2489, lr_0 = 9.2614e-04
Loss = 1.1075e-04, PNorm = 110.1584, GNorm = 0.0042, lr_0 = 9.2612e-04
Validation auc = 0.701618
Epoch 1486
Validation auc = 0.707249
Epoch 1487
Validation auc = 0.711240
Epoch 1488
Validation auc = 0.713645
Epoch 1489
Validation auc = 0.715395
Epoch 1490
Loss = 1.1240e-03, PNorm = 110.2292, GNorm = 0.0243, lr_0 = 9.2589e-04
Loss = 1.8199e-05, PNorm = 110.2341, GNorm = 0.0010, lr_0 = 9.2587e-04
Validation auc = 0.716925
Epoch 1491
Validation auc = 0.717527
Epoch 1492
Validation auc = 0.718839
Epoch 1493
Validation auc = 0.718948
Epoch 1494
Validation auc = 0.718292
Epoch 1495
Loss = 1.2132e-03, PNorm = 110.2786, GNorm = 0.0424, lr_0 = 9.2566e-04
Validation auc = 0.715996
Epoch 1496
Validation auc = 0.714247
Epoch 1497
Validation auc = 0.716160
Epoch 1498
Validation auc = 0.715559
Epoch 1499
Loss = 4.4653e-03, PNorm = 110.3260, GNorm = 0.0049, lr_0 = 9.2543e-04
Validation auc = 0.715832
Epoch 1500
Validation auc = 0.715012
Epoch 1501
Validation auc = 0.714629
Epoch 1502
Validation auc = 0.714520
Epoch 1503
Validation auc = 0.714083
Epoch 1504
Loss = 2.0175e-02, PNorm = 110.3627, GNorm = 0.0056, lr_0 = 9.2520e-04
Loss = 4.2452e-04, PNorm = 110.3644, GNorm = 0.0193, lr_0 = 9.2518e-04
Validation auc = 0.717035
Epoch 1505
Validation auc = 0.719003
Epoch 1506
Validation auc = 0.720534
Epoch 1507
Validation auc = 0.721572
Epoch 1508
Validation auc = 0.722720
Epoch 1509
Loss = 4.6928e-04, PNorm = 110.3889, GNorm = 0.0125, lr_0 = 9.2497e-04
Validation auc = 0.723212
Epoch 1510
Validation auc = 0.723103
Epoch 1511
Validation auc = 0.722994
Epoch 1512
Validation auc = 0.722994
Epoch 1513
Validation auc = 0.722939
Epoch 1514
Loss = 1.5756e-04, PNorm = 110.4097, GNorm = 0.0043, lr_0 = 9.2472e-04
Validation auc = 0.722939
Epoch 1515
Validation auc = 0.722720
Epoch 1516
Validation auc = 0.723267
Epoch 1517
Validation auc = 0.725618
Epoch 1518
Loss = 9.1074e-02, PNorm = 110.4392, GNorm = 2.7444, lr_0 = 9.2451e-04
Loss = 3.0278e-05, PNorm = 110.4424, GNorm = 0.0012, lr_0 = 9.2449e-04
Validation auc = 0.718347
Epoch 1519
Validation auc = 0.706429
Epoch 1520
Validation auc = 0.701017
Epoch 1521
Validation auc = 0.698557
Epoch 1522
Validation auc = 0.700306
Epoch 1523
Loss = 1.6634e-04, PNorm = 110.5207, GNorm = 0.0068, lr_0 = 9.2427e-04
Loss = 2.7258e-05, PNorm = 110.5258, GNorm = 0.0019, lr_0 = 9.2425e-04
Validation auc = 0.706538
Epoch 1524
Validation auc = 0.709983
Epoch 1525
Validation auc = 0.714848
Epoch 1526
Validation auc = 0.717253
Epoch 1527
Validation auc = 0.716871
Epoch 1528
Loss = 4.4212e-04, PNorm = 110.6214, GNorm = 0.0161, lr_0 = 9.2404e-04
Validation auc = 0.714137
Epoch 1529
Validation auc = 0.712060
Epoch 1530
Validation auc = 0.710857
Epoch 1531
Validation auc = 0.709436
Epoch 1532
Validation auc = 0.708561
Epoch 1533
Loss = 5.5606e-04, PNorm = 110.6943, GNorm = 0.0346, lr_0 = 9.2379e-04
Validation auc = 0.709654
Epoch 1534
Validation auc = 0.709818
Epoch 1535
Validation auc = 0.709053
Epoch 1536
Validation auc = 0.707850
Epoch 1537
Loss = 1.0893e-03, PNorm = 110.7413, GNorm = 0.0114, lr_0 = 9.2358e-04
Loss = 7.8107e-05, PNorm = 110.7449, GNorm = 0.0030, lr_0 = 9.2356e-04
Validation auc = 0.707577
Epoch 1538
Validation auc = 0.707686
Epoch 1539
Validation auc = 0.707686
Epoch 1540
Validation auc = 0.706429
Epoch 1541
Validation auc = 0.705773
Epoch 1542
Loss = 5.7750e-04, PNorm = 110.7754, GNorm = 0.0288, lr_0 = 9.2335e-04
Validation auc = 0.704625
Epoch 1543
Validation auc = 0.702985
Epoch 1544
Validation auc = 0.702165
Epoch 1545
Validation auc = 0.701454
Epoch 1546
Validation auc = 0.700634
Epoch 1547
Loss = 2.1680e-04, PNorm = 110.8126, GNorm = 0.0072, lr_0 = 9.2310e-04
Validation auc = 0.699705
Epoch 1548
Validation auc = 0.698994
Epoch 1549
Validation auc = 0.695878
Epoch 1550
Validation auc = 0.691122
Epoch 1551
Loss = 5.9799e-02, PNorm = 110.8235, GNorm = 2.0489, lr_0 = 9.2289e-04
Loss = 4.5572e-04, PNorm = 110.8234, GNorm = 0.0262, lr_0 = 9.2287e-04
Validation auc = 0.694566
Epoch 1552
Validation auc = 0.694621
Epoch 1553
Validation auc = 0.695550
Epoch 1554
Validation auc = 0.695714
Epoch 1555
Validation auc = 0.696315
Epoch 1556
Loss = 1.2257e-03, PNorm = 110.8382, GNorm = 0.0281, lr_0 = 9.2264e-04
Loss = 1.6798e-03, PNorm = 110.8400, GNorm = 0.0824, lr_0 = 9.2263e-04
Validation auc = 0.697245
Epoch 1557
Validation auc = 0.696643
Epoch 1558
Validation auc = 0.697518
Epoch 1559
Validation auc = 0.697081
Epoch 1560
Validation auc = 0.699486
Epoch 1561
Loss = 9.5411e-04, PNorm = 110.8562, GNorm = 0.0231, lr_0 = 9.2242e-04
Validation auc = 0.703313
Epoch 1562
Validation auc = 0.704570
Epoch 1563
Validation auc = 0.705336
Epoch 1564
Validation auc = 0.705500
Epoch 1565
Validation auc = 0.706429
Epoch 1566
Loss = 4.8227e-04, PNorm = 110.8878, GNorm = 0.0169, lr_0 = 9.2217e-04
Validation auc = 0.706812
Epoch 1567
Validation auc = 0.706702
Epoch 1568
Validation auc = 0.706976
Epoch 1569
Validation auc = 0.707194
Epoch 1570
Loss = 3.9169e-04, PNorm = 110.9080, GNorm = 0.0200, lr_0 = 9.2196e-04
Loss = 5.1288e-04, PNorm = 110.9091, GNorm = 0.0175, lr_0 = 9.2194e-04
Validation auc = 0.707085
Epoch 1571
Validation auc = 0.707194
Epoch 1572
Validation auc = 0.707249
Epoch 1573
Validation auc = 0.706702
Epoch 1574
Validation auc = 0.705609
Epoch 1575
Loss = 4.9566e-04, PNorm = 110.9146, GNorm = 0.0109, lr_0 = 9.2173e-04
Validation auc = 0.705008
Epoch 1576
Validation auc = 0.704734
Epoch 1577
Validation auc = 0.705117
Epoch 1578
Validation auc = 0.705336
Epoch 1579
Validation auc = 0.703641
Epoch 1580
Loss = 6.8411e-05, PNorm = 110.9300, GNorm = 0.0020, lr_0 = 9.2148e-04
Validation auc = 0.700908
Epoch 1581
Validation auc = 0.698666
Epoch 1582
Validation auc = 0.695987
Epoch 1583
Validation auc = 0.694785
Epoch 1584
Loss = 7.0376e-02, PNorm = 110.9605, GNorm = 1.3751, lr_0 = 9.2127e-04
Loss = 3.3886e-04, PNorm = 110.9619, GNorm = 0.0222, lr_0 = 9.2125e-04
Validation auc = 0.696206
Epoch 1585
Validation auc = 0.697791
Epoch 1586
Validation auc = 0.699267
Epoch 1587
Validation auc = 0.699595
Epoch 1588
Validation auc = 0.697518
Epoch 1589
Loss = 1.1648e-03, PNorm = 110.9898, GNorm = 0.0274, lr_0 = 9.2103e-04
Loss = 6.9997e-04, PNorm = 110.9941, GNorm = 0.0215, lr_0 = 9.2101e-04
Validation auc = 0.698283
Epoch 1590
Validation auc = 0.699322
Epoch 1591
Validation auc = 0.699213
Epoch 1592
Validation auc = 0.696971
Epoch 1593
Validation auc = 0.689755
Epoch 1594
Loss = 9.8053e-04, PNorm = 111.0694, GNorm = 0.0284, lr_0 = 9.2080e-04
Validation auc = 0.686038
Epoch 1595
Validation auc = 0.685218
Epoch 1596
Validation auc = 0.685327
Epoch 1597
Validation auc = 0.688388
Epoch 1598
Validation auc = 0.692325
Epoch 1599
Loss = 2.6048e-02, PNorm = 111.1503, GNorm = 1.7883, lr_0 = 9.2055e-04
Validation auc = 0.690411
Epoch 1600
Validation auc = 0.687623
Epoch 1601
Validation auc = 0.686530
Epoch 1602
Validation auc = 0.686858
Epoch 1603
Loss = 4.6144e-03, PNorm = 111.3006, GNorm = 0.1281, lr_0 = 9.2034e-04
Loss = 1.9408e-04, PNorm = 111.3092, GNorm = 0.0082, lr_0 = 9.2032e-04
Validation auc = 0.686912
Epoch 1604
Validation auc = 0.686530
Epoch 1605
Validation auc = 0.686858
Epoch 1606
Validation auc = 0.690192
Epoch 1607
Validation auc = 0.692653
Epoch 1608
Loss = 5.5455e-04, PNorm = 111.3892, GNorm = 0.0075, lr_0 = 9.2010e-04
Validation auc = 0.695441
Epoch 1609
Validation auc = 0.693910
Epoch 1610
Validation auc = 0.692543
Epoch 1611
Validation auc = 0.688607
Epoch 1612
Validation auc = 0.687076
Epoch 1613
Loss = 1.7342e-03, PNorm = 111.4437, GNorm = 0.0616, lr_0 = 9.1987e-04
Validation auc = 0.685819
Epoch 1614
Validation auc = 0.685491
Epoch 1615
Validation auc = 0.685764
Epoch 1616
Validation auc = 0.687131
Epoch 1617
Loss = 1.2026e-03, PNorm = 111.4733, GNorm = 0.0141, lr_0 = 9.1966e-04
Loss = 2.1593e-04, PNorm = 111.4753, GNorm = 0.0063, lr_0 = 9.1964e-04
Validation auc = 0.686967
Epoch 1618
Validation auc = 0.686147
Epoch 1619
Validation auc = 0.685327
Epoch 1620
Validation auc = 0.686694
Epoch 1621
Validation auc = 0.681172
Epoch 1622
Loss = 1.3288e-03, PNorm = 111.4977, GNorm = 0.0655, lr_0 = 9.1941e-04
Loss = 3.6870e-04, PNorm = 111.4995, GNorm = 0.0147, lr_0 = 9.1939e-04
Validation auc = 0.679477
Epoch 1623
Validation auc = 0.678111
Epoch 1624
Validation auc = 0.679040
Epoch 1625
Validation auc = 0.679587
Epoch 1626
Validation auc = 0.681555
Epoch 1627
Loss = 3.5226e-04, PNorm = 111.5398, GNorm = 0.0105, lr_0 = 9.1918e-04
Validation auc = 0.681555
Epoch 1628
Validation auc = 0.681828
Epoch 1629
Validation auc = 0.681773
Epoch 1630
Validation auc = 0.681172
Epoch 1631
Validation auc = 0.677837
Epoch 1632
Loss = 1.3591e-02, PNorm = 111.5704, GNorm = 1.2299, lr_0 = 9.1894e-04
Validation auc = 0.672917
Epoch 1633
Validation auc = 0.671004
Epoch 1634
Validation auc = 0.667942
Epoch 1635
Validation auc = 0.666794
Epoch 1636
Loss = 8.1142e-04, PNorm = 111.6418, GNorm = 0.0274, lr_0 = 9.1873e-04
Loss = 1.9656e-04, PNorm = 111.6457, GNorm = 0.0064, lr_0 = 9.1871e-04
Validation auc = 0.666193
Epoch 1637
Validation auc = 0.664498
Epoch 1638
Validation auc = 0.666193
Epoch 1639
Validation auc = 0.666357
Epoch 1640
Validation auc = 0.667505
Epoch 1641
Loss = 4.8646e-03, PNorm = 111.6958, GNorm = 0.5316, lr_0 = 9.1848e-04
Validation auc = 0.667177
Epoch 1642
Validation auc = 0.666302
Epoch 1643
Validation auc = 0.666576
Epoch 1644
Validation auc = 0.666576
Epoch 1645
Validation auc = 0.666521
Epoch 1646
Loss = 1.5996e-02, PNorm = 111.7335, GNorm = 1.9886, lr_0 = 9.1825e-04
Validation auc = 0.665428
Epoch 1647
Validation auc = 0.665154
Epoch 1648
Validation auc = 0.665373
Epoch 1649
Validation auc = 0.664990
Epoch 1650
Loss = 2.5982e-04, PNorm = 111.7644, GNorm = 0.0165, lr_0 = 9.1804e-04
Loss = 7.0044e-04, PNorm = 111.7661, GNorm = 0.0394, lr_0 = 9.1803e-04
Validation auc = 0.664826
Epoch 1651
Validation auc = 0.664170
Epoch 1652
Validation auc = 0.663951
Epoch 1653
Validation auc = 0.664607
Epoch 1654
Validation auc = 0.666685
Epoch 1655
Loss = 2.9441e-03, PNorm = 111.7908, GNorm = 0.2628, lr_0 = 9.1780e-04
Loss = 3.8347e-03, PNorm = 111.7943, GNorm = 0.4487, lr_0 = 9.1778e-04
Validation auc = 0.668708
Epoch 1656
Validation auc = 0.667942
Epoch 1657
Validation auc = 0.666302
Epoch 1658
Validation auc = 0.665756
Epoch 1659
Validation auc = 0.664990
Epoch 1660
Loss = 9.3709e-05, PNorm = 111.8442, GNorm = 0.0040, lr_0 = 9.1757e-04
Validation auc = 0.665209
Epoch 1661
Validation auc = 0.674503
Epoch 1662
Validation auc = 0.693691
Epoch 1663
Validation auc = 0.701946
Epoch 1664
Validation auc = 0.695277
Epoch 1665
Loss = 2.0721e-03, PNorm = 111.9183, GNorm = 0.0849, lr_0 = 9.1733e-04
Validation auc = 0.692379
Epoch 1666
Validation auc = 0.689919
Epoch 1667
Validation auc = 0.686092
Epoch 1668
Validation auc = 0.685819
Epoch 1669
Loss = 3.0813e-02, PNorm = 111.9903, GNorm = 0.0645, lr_0 = 9.1712e-04
Loss = 9.7191e-04, PNorm = 111.9942, GNorm = 0.0355, lr_0 = 9.1710e-04
Validation auc = 0.688388
Epoch 1670
Validation auc = 0.688552
Epoch 1671
Validation auc = 0.693691
Epoch 1672
Validation auc = 0.700579
Epoch 1673
Validation auc = 0.704188
Epoch 1674
Loss = 4.6436e-02, PNorm = 112.1021, GNorm = 0.6237, lr_0 = 9.1687e-04
Validation auc = 0.710256
Epoch 1675
Validation auc = 0.705937
Epoch 1676
Validation auc = 0.701017
Epoch 1677
Validation auc = 0.697354
Epoch 1678
Validation auc = 0.694785
Epoch 1679
Loss = 4.0331e-03, PNorm = 112.2569, GNorm = 0.0963, lr_0 = 9.1664e-04
Validation auc = 0.689919
Epoch 1680
Validation auc = 0.686694
Epoch 1681
Validation auc = 0.682047
Epoch 1682
Validation auc = 0.679095
Epoch 1683
Loss = 2.7622e-03, PNorm = 112.3497, GNorm = 0.0250, lr_0 = 9.1642e-04
Validation auc = 0.677564
Epoch 1684
Validation auc = 0.676361
Epoch 1685
Validation auc = 0.675651
Epoch 1686
Validation auc = 0.674393
Epoch 1687
Validation auc = 0.673354
Epoch 1688
Loss = 1.1017e-03, PNorm = 112.4036, GNorm = 0.0490, lr_0 = 9.1619e-04
Loss = 2.7178e-05, PNorm = 112.4076, GNorm = 0.0018, lr_0 = 9.1617e-04
Validation auc = 0.671332
Epoch 1689
Validation auc = 0.671386
Epoch 1690
Validation auc = 0.670621
Epoch 1691
Validation auc = 0.667997
Epoch 1692
Validation auc = 0.664771
Epoch 1693
Loss = 1.1876e-04, PNorm = 112.4649, GNorm = 0.0037, lr_0 = 9.1596e-04
Validation auc = 0.663131
Epoch 1694
Validation auc = 0.662093
Epoch 1695
Validation auc = 0.661601
Epoch 1696
Validation auc = 0.661109
Epoch 1697
Validation auc = 0.661109
Epoch 1698
Loss = 3.2350e-04, PNorm = 112.5072, GNorm = 0.0104, lr_0 = 9.1572e-04
Validation auc = 0.660234
Epoch 1699
Validation auc = 0.660343
Epoch 1700
Validation auc = 0.660234
Epoch 1701
Validation auc = 0.660070
Epoch 1702
Loss = 3.4564e-04, PNorm = 112.5269, GNorm = 0.0090, lr_0 = 9.1551e-04
Loss = 1.3510e-06, PNorm = 112.5279, GNorm = 0.0001, lr_0 = 9.1549e-04
Validation auc = 0.659742
Epoch 1703
Validation auc = 0.659797
Epoch 1704
Validation auc = 0.660015
Epoch 1705
Validation auc = 0.668325
Epoch 1706
Validation auc = 0.676307
Epoch 1707
Loss = 7.1255e-03, PNorm = 112.5448, GNorm = 0.8015, lr_0 = 9.1526e-04
Loss = 5.5854e-04, PNorm = 112.5468, GNorm = 0.0231, lr_0 = 9.1525e-04
Validation auc = 0.681445
Epoch 1708
Validation auc = 0.685382
Epoch 1709
Validation auc = 0.688716
Epoch 1710
Validation auc = 0.692817
Epoch 1711
Validation auc = 0.696206
Epoch 1712
Loss = 1.3478e-04, PNorm = 112.5685, GNorm = 0.0069, lr_0 = 9.1504e-04
Validation auc = 0.698393
Epoch 1713
Validation auc = 0.699923
Epoch 1714
Validation auc = 0.701837
Epoch 1715
Validation auc = 0.700853
Epoch 1716
Loss = 4.5203e-04, PNorm = 112.6126, GNorm = 0.0005, lr_0 = 9.1481e-04
Validation auc = 0.700415
Epoch 1717
Validation auc = 0.701017
Epoch 1718
Validation auc = 0.694238
Epoch 1719
Validation auc = 0.694511
Epoch 1720
Validation auc = 0.693363
Epoch 1721
Loss = 8.3214e-03, PNorm = 112.6674, GNorm = 0.2702, lr_0 = 9.1458e-04
Loss = 4.6409e-05, PNorm = 112.6713, GNorm = 0.0023, lr_0 = 9.1457e-04
Validation auc = 0.692981
Epoch 1722
Validation auc = 0.692434
Epoch 1723
Validation auc = 0.690848
Epoch 1724
Validation auc = 0.690356
Epoch 1725
Validation auc = 0.688662
Epoch 1726
Loss = 4.5545e-04, PNorm = 112.7157, GNorm = 0.0121, lr_0 = 9.1436e-04
Validation auc = 0.688388
Epoch 1727
Validation auc = 0.688006
Epoch 1728
Validation auc = 0.687076
Epoch 1729
Validation auc = 0.686420
Epoch 1730
Validation auc = 0.685764
Epoch 1731
Loss = 2.7744e-04, PNorm = 112.7396, GNorm = 0.0070, lr_0 = 9.1411e-04
Validation auc = 0.685655
Epoch 1732
Validation auc = 0.685382
Epoch 1733
Validation auc = 0.684944
Epoch 1734
Validation auc = 0.686420
Epoch 1735
Loss = 6.9340e-04, PNorm = 112.7513, GNorm = 0.1189, lr_0 = 9.1390e-04
Loss = 1.3560e-04, PNorm = 112.7529, GNorm = 0.0052, lr_0 = 9.1389e-04
Validation auc = 0.687076
Epoch 1736
Validation auc = 0.683523
Epoch 1737
Validation auc = 0.680297
Epoch 1738
Validation auc = 0.678165
Epoch 1739
Validation auc = 0.676143
Epoch 1740
Loss = 2.2606e-04, PNorm = 112.7694, GNorm = 0.0048, lr_0 = 9.1366e-04
Loss = 1.8058e-04, PNorm = 112.7706, GNorm = 0.0063, lr_0 = 9.1364e-04
Validation auc = 0.674557
Epoch 1741
Validation auc = 0.673190
Epoch 1742
Validation auc = 0.672097
Epoch 1743
Validation auc = 0.671878
Epoch 1744
Validation auc = 0.670949
Epoch 1745
Loss = 3.2448e-03, PNorm = 112.7846, GNorm = 0.6005, lr_0 = 9.1343e-04
Validation auc = 0.670676
Epoch 1746
Validation auc = 0.669036
Epoch 1747
Validation auc = 0.676197
Epoch 1748
Validation auc = 0.679532
Epoch 1749
Loss = 2.1885e-02, PNorm = 112.7932, GNorm = 0.0384, lr_0 = 9.1320e-04
Validation auc = 0.679532
Epoch 1750
Validation auc = 0.679477
Epoch 1751
Validation auc = 0.679532
Epoch 1752
Validation auc = 0.679969
Epoch 1753
Validation auc = 0.680680
Epoch 1754
Loss = 4.1589e-04, PNorm = 112.8204, GNorm = 0.0075, lr_0 = 9.1298e-04
Loss = 8.3770e-05, PNorm = 112.8222, GNorm = 0.0041, lr_0 = 9.1296e-04
Validation auc = 0.680297
Epoch 1755
Validation auc = 0.680079
Epoch 1756
Validation auc = 0.679751
Epoch 1757
Validation auc = 0.679040
Epoch 1758
Validation auc = 0.679095
Epoch 1759
Loss = 1.4437e-02, PNorm = 112.8405, GNorm = 1.7832, lr_0 = 9.1275e-04
Validation auc = 0.675760
Epoch 1760
Validation auc = 0.673464
Epoch 1761
Validation auc = 0.671605
Epoch 1762
Validation auc = 0.670129
Epoch 1763
Validation auc = 0.668653
Epoch 1764
Loss = 8.7105e-05, PNorm = 112.8748, GNorm = 0.0028, lr_0 = 9.1251e-04
Validation auc = 0.670020
Epoch 1765
Validation auc = 0.672534
Epoch 1766
Validation auc = 0.676088
Epoch 1767
Validation auc = 0.679204
Epoch 1768
Loss = 5.7391e-05, PNorm = 112.8848, GNorm = 0.0025, lr_0 = 9.1230e-04
Loss = 6.8346e-06, PNorm = 112.8858, GNorm = 0.0003, lr_0 = 9.1228e-04
Validation auc = 0.683031
Epoch 1769
Validation auc = 0.685327
Epoch 1770
Validation auc = 0.687678
Epoch 1771
Validation auc = 0.689263
Epoch 1772
Validation auc = 0.690138
Epoch 1773
Loss = 9.3945e-05, PNorm = 112.8956, GNorm = 0.0053, lr_0 = 9.1206e-04
Loss = 1.2397e-05, PNorm = 112.8961, GNorm = 0.0006, lr_0 = 9.1204e-04
Validation auc = 0.690302
Epoch 1774
Validation auc = 0.691231
Epoch 1775
Validation auc = 0.691778
Epoch 1776
Validation auc = 0.692270
Epoch 1777
Validation auc = 0.687459
Epoch 1778
Loss = 3.4516e-04, PNorm = 112.8929, GNorm = 0.0114, lr_0 = 9.1183e-04
Validation auc = 0.685600
Epoch 1779
Validation auc = 0.684015
Epoch 1780
Validation auc = 0.683304
Epoch 1781
Validation auc = 0.682921
Epoch 1782
Validation auc = 0.682484
Epoch 1783
Loss = 4.9336e-04, PNorm = 112.9117, GNorm = 0.0141, lr_0 = 9.1159e-04
Validation auc = 0.681883
Epoch 1784
Validation auc = 0.681664
Epoch 1785
Validation auc = 0.680953
Epoch 1786
Validation auc = 0.680407
Epoch 1787
Loss = 3.8006e-04, PNorm = 112.9348, GNorm = 0.0113, lr_0 = 9.1138e-04
Loss = 1.5351e-03, PNorm = 112.9366, GNorm = 0.0489, lr_0 = 9.1136e-04
Validation auc = 0.680407
Epoch 1788
Validation auc = 0.679915
Epoch 1789
Validation auc = 0.679969
Epoch 1790
Validation auc = 0.674557
Epoch 1791
Validation auc = 0.677400
Epoch 1792
Loss = 6.5526e-03, PNorm = 112.9586, GNorm = 0.4078, lr_0 = 9.1115e-04
Validation auc = 0.680243
Epoch 1793
Validation auc = 0.681555
Epoch 1794
Validation auc = 0.681719
Epoch 1795
Validation auc = 0.682156
Epoch 1796
Validation auc = 0.682593
Epoch 1797
Loss = 1.5319e-04, PNorm = 113.0018, GNorm = 0.0043, lr_0 = 9.1091e-04
Validation auc = 0.682211
Epoch 1798
Validation auc = 0.682265
Epoch 1799
Validation auc = 0.681992
Epoch 1800
Validation auc = 0.681937
Epoch 1801
Loss = 4.1706e-04, PNorm = 113.0221, GNorm = 0.0202, lr_0 = 9.1070e-04
Loss = 9.1394e-07, PNorm = 113.0232, GNorm = 0.0000, lr_0 = 9.1068e-04
Validation auc = 0.681828
Epoch 1802
Validation auc = 0.680789
Epoch 1803
Validation auc = 0.675268
Epoch 1804
Validation auc = 0.667232
Epoch 1805
Validation auc = 0.665209
Epoch 1806
Loss = 6.2964e-02, PNorm = 113.0645, GNorm = 0.8737, lr_0 = 9.1046e-04
Loss = 6.8152e-03, PNorm = 113.0740, GNorm = 0.2708, lr_0 = 9.1044e-04
Validation auc = 0.666193
Epoch 1807
Validation auc = 0.667669
Epoch 1808
Validation auc = 0.674284
Epoch 1809
Validation auc = 0.682539
Epoch 1810
Validation auc = 0.689919
Epoch 1811
Loss = 8.5134e-03, PNorm = 113.2455, GNorm = 0.1814, lr_0 = 9.1023e-04
Validation auc = 0.697354
Epoch 1812
Validation auc = 0.700634
Epoch 1813
Validation auc = 0.699923
Epoch 1814
Validation auc = 0.696753
Epoch 1815
Validation auc = 0.693035
Epoch 1816
Loss = 1.2461e-02, PNorm = 113.4547, GNorm = 0.5258, lr_0 = 9.0999e-04
Validation auc = 0.690247
Epoch 1817
Validation auc = 0.688224
Epoch 1818
Validation auc = 0.686858
Epoch 1819
Validation auc = 0.687186
Epoch 1820
Loss = 7.2135e-04, PNorm = 113.5488, GNorm = 0.0530, lr_0 = 9.0978e-04
Loss = 2.0118e-04, PNorm = 113.5534, GNorm = 0.0078, lr_0 = 9.0976e-04
Validation auc = 0.687896
Epoch 1821
Validation auc = 0.687514
Epoch 1822
Validation auc = 0.687732
Epoch 1823
Validation auc = 0.688224
Epoch 1824
Validation auc = 0.688552
Epoch 1825
Loss = 2.9753e-04, PNorm = 113.5952, GNorm = 0.0166, lr_0 = 9.0955e-04
Validation auc = 0.687842
Epoch 1826
Validation auc = 0.684835
Epoch 1827
Validation auc = 0.683851
Epoch 1828
Validation auc = 0.683960
Epoch 1829
Validation auc = 0.682429
Epoch 1830
Loss = 2.4793e-03, PNorm = 113.6368, GNorm = 0.2202, lr_0 = 9.0931e-04
Validation auc = 0.680789
Epoch 1831
Validation auc = 0.679915
Epoch 1832
Validation auc = 0.680680
Epoch 1833
Validation auc = 0.681172
Epoch 1834
Loss = 3.5124e-05, PNorm = 113.6655, GNorm = 0.0016, lr_0 = 9.0910e-04
Loss = 7.7486e-07, PNorm = 113.6672, GNorm = 0.0001, lr_0 = 9.0909e-04
Validation auc = 0.681281
Epoch 1835
Validation auc = 0.681937
Epoch 1836
Validation auc = 0.682211
Epoch 1837
Validation auc = 0.682211
Epoch 1838
Validation auc = 0.682429
Epoch 1839
Loss = 7.0093e-05, PNorm = 113.6815, GNorm = 0.0150, lr_0 = 9.0886e-04
Loss = 1.9868e-07, PNorm = 113.6820, GNorm = 0.0000, lr_0 = 9.0884e-04
Validation auc = 0.682539
Epoch 1840
Validation auc = 0.682101
Epoch 1841
Validation auc = 0.681992
Epoch 1842
Validation auc = 0.682156
Epoch 1843
Validation auc = 0.681883
Epoch 1844
Loss = 3.3232e-04, PNorm = 113.6867, GNorm = 0.0509, lr_0 = 9.0863e-04
Validation auc = 0.682265
Epoch 1845
Validation auc = 0.682265
Epoch 1846
Validation auc = 0.674612
Epoch 1847
Validation auc = 0.673901
Epoch 1848
Validation auc = 0.674667
Epoch 1849
Loss = 3.5465e-04, PNorm = 113.7739, GNorm = 0.0082, lr_0 = 9.0839e-04
Validation auc = 0.675596
Epoch 1850
Validation auc = 0.675432
Epoch 1851
Validation auc = 0.677455
Epoch 1852
Validation auc = 0.677509
Epoch 1853
Loss = 2.8083e-02, PNorm = 113.9760, GNorm = 0.3459, lr_0 = 9.0818e-04
Loss = 4.3273e-03, PNorm = 113.9871, GNorm = 0.3527, lr_0 = 9.0817e-04
Validation auc = 0.685819
Epoch 1854
Validation auc = 0.688170
Epoch 1855
Validation auc = 0.686420
Epoch 1856
Validation auc = 0.685272
Epoch 1857
Validation auc = 0.672862
Epoch 1858
Loss = 1.6213e-01, PNorm = 114.1627, GNorm = 4.9545, lr_0 = 9.0794e-04
Validation auc = 0.669801
Epoch 1859
Validation auc = 0.693309
Epoch 1860
Validation auc = 0.709818
Epoch 1861
Validation auc = 0.683468
Epoch 1862
Validation auc = 0.662038
Epoch 1863
Loss = 2.1538e-02, PNorm = 114.4360, GNorm = 0.4850, lr_0 = 9.0772e-04
Validation auc = 0.631260
Epoch 1864
Validation auc = 0.629127
Epoch 1865
Validation auc = 0.633064
Epoch 1866
Validation auc = 0.636070
Epoch 1867
Loss = 1.1298e-02, PNorm = 114.6661, GNorm = 0.4785, lr_0 = 9.0751e-04
Loss = 4.0888e-03, PNorm = 114.6807, GNorm = 0.2333, lr_0 = 9.0749e-04
Validation auc = 0.643396
Epoch 1868
Validation auc = 0.649191
Epoch 1869
Validation auc = 0.654220
Epoch 1870
Validation auc = 0.656899
Epoch 1871
Validation auc = 0.659961
Epoch 1872
Loss = 5.6719e-03, PNorm = 114.8245, GNorm = 0.5921, lr_0 = 9.0727e-04
Loss = 3.1021e-04, PNorm = 114.8322, GNorm = 0.0155, lr_0 = 9.0725e-04
Validation auc = 0.660890
Epoch 1873
Validation auc = 0.661601
Epoch 1874
Validation auc = 0.662038
Epoch 1875
Validation auc = 0.661819
Epoch 1876
Validation auc = 0.662202
Epoch 1877
Loss = 6.0957e-02, PNorm = 114.9074, GNorm = 1.0473, lr_0 = 9.0704e-04
Validation auc = 0.660617
Epoch 1878
Validation auc = 0.659523
Epoch 1879
Validation auc = 0.661655
Epoch 1880
Validation auc = 0.661218
Epoch 1881
Validation auc = 0.659086
Epoch 1882
Loss = 1.0830e-04, PNorm = 114.9756, GNorm = 0.0040, lr_0 = 9.0680e-04
Validation auc = 0.658430
Epoch 1883
Validation auc = 0.658321
Epoch 1884
Validation auc = 0.657938
Epoch 1885
Validation auc = 0.653947
Epoch 1886
Loss = 8.3581e-05, PNorm = 115.0097, GNorm = 0.0029, lr_0 = 9.0659e-04
Loss = 2.3940e-05, PNorm = 115.0121, GNorm = 0.0012, lr_0 = 9.0657e-04
Validation auc = 0.651104
Epoch 1887
Validation auc = 0.648972
Epoch 1888
Validation auc = 0.647442
Epoch 1889
Validation auc = 0.645856
Epoch 1890
Validation auc = 0.644981
Epoch 1891
Loss = 1.6788e-04, PNorm = 115.0415, GNorm = 0.0039, lr_0 = 9.0635e-04
Validation auc = 0.644763
Epoch 1892
Validation auc = 0.643943
Epoch 1893
Validation auc = 0.643396
Epoch 1894
Validation auc = 0.643724
Epoch 1895
Validation auc = 0.643560
Epoch 1896
Loss = 3.4710e-04, PNorm = 115.0587, GNorm = 0.0162, lr_0 = 9.0612e-04
Validation auc = 0.644325
Epoch 1897
Validation auc = 0.644325
Epoch 1898
Validation auc = 0.645091
Epoch 1899
Validation auc = 0.645965
Epoch 1900
Loss = 1.0840e-04, PNorm = 115.0858, GNorm = 0.0011, lr_0 = 9.0592e-04
Loss = 6.3578e-07, PNorm = 115.0873, GNorm = 0.0000, lr_0 = 9.0590e-04
Validation auc = 0.646949
Epoch 1901
Validation auc = 0.647606
Epoch 1902
Validation auc = 0.648043
Epoch 1903
Validation auc = 0.649300
Epoch 1904
Validation auc = 0.650558
Epoch 1905
Loss = 9.2970e-04, PNorm = 115.1023, GNorm = 0.0080, lr_0 = 9.0567e-04
Loss = 1.2812e-04, PNorm = 115.1040, GNorm = 0.0054, lr_0 = 9.0566e-04
Validation auc = 0.651870
Epoch 1906
Validation auc = 0.651870
Epoch 1907
Validation auc = 0.652307
Epoch 1908
Validation auc = 0.653892
Epoch 1909
Validation auc = 0.654986
Epoch 1910
Loss = 1.2611e-03, PNorm = 115.1378, GNorm = 0.0416, lr_0 = 9.0545e-04
Validation auc = 0.655259
Epoch 1911
Validation auc = 0.656134
Epoch 1912
Validation auc = 0.656243
Epoch 1913
Validation auc = 0.655860
Epoch 1914
Validation auc = 0.655806
Epoch 1915
Loss = 1.3285e-04, PNorm = 115.1694, GNorm = 0.0045, lr_0 = 9.0521e-04
Validation auc = 0.651077
Epoch 1916
Validation auc = 0.656735
Epoch 1917
Validation auc = 0.659250
Epoch 1918
Validation auc = 0.656462
Epoch 1919
Loss = 7.5694e-02, PNorm = 115.2023, GNorm = 1.5983, lr_0 = 9.0500e-04
Loss = 3.6236e-05, PNorm = 115.2032, GNorm = 0.0015, lr_0 = 9.0498e-04
Validation auc = 0.654330
Epoch 1920
Validation auc = 0.652416
Epoch 1921
Validation auc = 0.650667
Epoch 1922
Validation auc = 0.654712
Epoch 1923
Validation auc = 0.656298
Epoch 1924
Loss = 6.7424e-03, PNorm = 115.2456, GNorm = 0.6511, lr_0 = 9.0476e-04
Validation auc = 0.654603
Epoch 1925
Validation auc = 0.652744
Epoch 1926
Validation auc = 0.652034
Epoch 1927
Validation auc = 0.649738
Epoch 1928
Validation auc = 0.651104
Epoch 1929
Loss = 5.3760e-04, PNorm = 115.3064, GNorm = 0.0162, lr_0 = 9.0454e-04
Validation auc = 0.658321
Epoch 1930
Validation auc = 0.680243
Epoch 1931
Validation auc = 0.684234
Epoch 1932
Validation auc = 0.679204
Epoch 1933
Loss = 4.8727e-03, PNorm = 115.5151, GNorm = 0.0706, lr_0 = 9.0431e-04
Validation auc = 0.678712
Epoch 1934
Validation auc = 0.677892
Epoch 1935
Validation auc = 0.676525
Epoch 1936
Validation auc = 0.675760
Epoch 1937
Validation auc = 0.675869
Epoch 1938
Loss = 2.8955e-03, PNorm = 115.6712, GNorm = 0.0779, lr_0 = 9.0409e-04
Loss = 4.4309e-04, PNorm = 115.6791, GNorm = 0.0140, lr_0 = 9.0407e-04
Validation auc = 0.675432
Epoch 1939
Validation auc = 0.689099
Epoch 1940
Validation auc = 0.688662
Epoch 1941
Validation auc = 0.686584
Epoch 1942
Validation auc = 0.682757
Epoch 1943
Loss = 1.0885e-02, PNorm = 115.7939, GNorm = 0.2114, lr_0 = 9.0386e-04
Validation auc = 0.680680
Epoch 1944
Validation auc = 0.678603
Epoch 1945
Validation auc = 0.675815
Epoch 1946
Validation auc = 0.675760
Epoch 1947
Validation auc = 0.680297
Epoch 1948
Loss = 2.5391e-03, PNorm = 115.9638, GNorm = 0.0720, lr_0 = 9.0362e-04
Validation auc = 0.685710
Epoch 1949
Validation auc = 0.690192
Epoch 1950
Validation auc = 0.694457
Epoch 1951
Validation auc = 0.696862
Epoch 1952
Loss = 5.5434e-03, PNorm = 116.0943, GNorm = 1.2745, lr_0 = 9.0341e-04
Loss = 2.4046e-04, PNorm = 116.1025, GNorm = 0.0087, lr_0 = 9.0340e-04
Validation auc = 0.695386
Epoch 1953
Validation auc = 0.692707
Epoch 1954
Validation auc = 0.692926
Epoch 1955
Validation auc = 0.686584
Epoch 1956
Validation auc = 0.681336
Epoch 1957
Loss = 1.9006e-02, PNorm = 116.2035, GNorm = 2.9395, lr_0 = 9.0317e-04
Loss = 1.1874e-03, PNorm = 116.2083, GNorm = 0.0545, lr_0 = 9.0316e-04
Validation auc = 0.681500
Epoch 1958
Validation auc = 0.681172
Epoch 1959
Validation auc = 0.680352
Epoch 1960
Validation auc = 0.678001
Epoch 1961
Validation auc = 0.678001
Epoch 1962
Loss = 2.3612e-04, PNorm = 116.2790, GNorm = 0.0071, lr_0 = 9.0295e-04
Validation auc = 0.673190
Epoch 1963
Validation auc = 0.667833
Epoch 1964
Validation auc = 0.666958
Epoch 1965
Validation auc = 0.668708
Epoch 1966
Loss = 7.8515e-03, PNorm = 116.3487, GNorm = 0.0766, lr_0 = 9.0273e-04
Validation auc = 0.669965
Epoch 1967
Validation auc = 0.670348
Epoch 1968
Validation auc = 0.671277
Epoch 1969
Validation auc = 0.673464
Epoch 1970
Validation auc = 0.674612
Epoch 1971
Loss = 2.0881e-02, PNorm = 116.3906, GNorm = 1.1319, lr_0 = 9.0250e-04
Loss = 4.0061e-04, PNorm = 116.3934, GNorm = 0.0165, lr_0 = 9.0249e-04
Validation auc = 0.676799
Epoch 1972
Validation auc = 0.678329
Epoch 1973
Validation auc = 0.680079
Epoch 1974
Validation auc = 0.681773
Epoch 1975
Validation auc = 0.678876
Epoch 1976
Loss = 1.2690e-03, PNorm = 116.4276, GNorm = 0.0357, lr_0 = 9.0228e-04
Validation auc = 0.677181
Epoch 1977
Validation auc = 0.675869
Epoch 1978
Validation auc = 0.675159
Epoch 1979
Validation auc = 0.673245
Epoch 1980
Validation auc = 0.672808
Epoch 1981
Loss = 1.4616e-03, PNorm = 116.4563, GNorm = 0.0407, lr_0 = 9.0204e-04
Validation auc = 0.675104
Epoch 1982
Validation auc = 0.678329
Epoch 1983
Validation auc = 0.681172
Epoch 1984
Validation auc = 0.680953
Epoch 1985
Loss = 1.1356e-03, PNorm = 116.4854, GNorm = 0.0053, lr_0 = 9.0183e-04
Loss = 7.4668e-04, PNorm = 116.4883, GNorm = 0.0484, lr_0 = 9.0181e-04
Validation auc = 0.680188
Epoch 1986
Validation auc = 0.679915
Epoch 1987
Validation auc = 0.679805
Epoch 1988
Validation auc = 0.677400
Epoch 1989
Validation auc = 0.668872
Epoch 1990
Loss = 4.6966e-05, PNorm = 116.5185, GNorm = 0.0067, lr_0 = 9.0159e-04
Loss = 3.1131e-05, PNorm = 116.5206, GNorm = 0.0016, lr_0 = 9.0157e-04
Validation auc = 0.660726
Epoch 1991
Validation auc = 0.664826
Epoch 1992
Validation auc = 0.667942
Epoch 1993
Validation auc = 0.669801
Epoch 1994
Validation auc = 0.675815
Epoch 1995
Loss = 1.4930e-03, PNorm = 116.5904, GNorm = 0.1744, lr_0 = 9.0137e-04
Validation auc = 0.678876
Epoch 1996
Validation auc = 0.680953
Epoch 1997
Validation auc = 0.680079
Epoch 1998
Validation auc = 0.679532
Epoch 1999
Loss = 4.7592e-05, PNorm = 116.6514, GNorm = 0.0001, lr_0 = 9.0114e-04
Validation auc = 0.679259
Model 0 best validation auc = 0.740706 on epoch 1054
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.571777
Ensemble test auc = 0.571777
Fold 3
Splitting data with seed 3
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.410343
Epoch 1
Validation auc = 0.545812
Epoch 2
Validation auc = 0.404658
Epoch 3
Validation auc = 0.675760
Epoch 4
Loss = 6.9832e-01, PNorm = 71.6138, GNorm = 1.8910, lr_0 = 2.0385e-04
Loss = 6.9224e-01, PNorm = 71.6149, GNorm = 2.5180, lr_0 = 2.1077e-04
Validation auc = 0.544610
Epoch 5
Validation auc = 0.709217
Epoch 6
Validation auc = 0.640335
Epoch 7
Validation auc = 0.699978
Epoch 8
Validation auc = 0.716324
Epoch 9
Loss = 6.7915e-01, PNorm = 71.6339, GNorm = 0.9866, lr_0 = 3.0077e-04
Validation auc = 0.705062
Epoch 10
Validation auc = 0.704734
Epoch 11
Validation auc = 0.685436
Epoch 12
Validation auc = 0.719331
Epoch 13
Validation auc = 0.721736
Epoch 14
Loss = 6.7242e-01, PNorm = 71.6725, GNorm = 0.5637, lr_0 = 4.0462e-04
Validation auc = 0.726711
Epoch 15
Validation auc = 0.714575
Epoch 16
Validation auc = 0.713099
Epoch 17
Validation auc = 0.730101
Epoch 18
Loss = 6.9331e-01, PNorm = 71.7287, GNorm = 1.4467, lr_0 = 4.9462e-04
Loss = 7.6593e-01, PNorm = 71.7333, GNorm = 1.7976, lr_0 = 5.0154e-04
Validation auc = 0.675213
Epoch 19
Validation auc = 0.694238
Epoch 20
Validation auc = 0.636344
Epoch 21
Validation auc = 0.642795
Epoch 22
Validation auc = 0.667724
Epoch 23
Loss = 6.5275e-01, PNorm = 71.8170, GNorm = 0.5214, lr_0 = 5.9846e-04
Loss = 4.2397e-01, PNorm = 71.8270, GNorm = 1.1067, lr_0 = 6.0538e-04
Validation auc = 0.661491
Epoch 24
Validation auc = 0.679641
Epoch 25
Validation auc = 0.669528
Epoch 26
Validation auc = 0.678220
Epoch 27
Validation auc = 0.671824
Epoch 28
Loss = 6.4472e-01, PNorm = 71.9249, GNorm = 0.6010, lr_0 = 6.9538e-04
Validation auc = 0.649136
Epoch 29
Validation auc = 0.631533
Epoch 30
Validation auc = 0.616007
Epoch 31
Validation auc = 0.611360
Epoch 32
Validation auc = 0.608244
Epoch 33
Loss = 6.4103e-01, PNorm = 72.0651, GNorm = 1.6119, lr_0 = 7.9923e-04
Validation auc = 0.618030
Epoch 34
Validation auc = 0.618686
Epoch 35
Validation auc = 0.618631
Epoch 36
Validation auc = 0.576700
Epoch 37
Loss = 6.5671e-01, PNorm = 72.2052, GNorm = 0.5220, lr_0 = 8.8923e-04
Loss = 6.3201e-01, PNorm = 72.2186, GNorm = 1.2729, lr_0 = 8.9615e-04
Validation auc = 0.632517
Epoch 38
Validation auc = 0.606768
Epoch 39
Validation auc = 0.618194
Epoch 40
Validation auc = 0.604964
Epoch 41
Validation auc = 0.621201
Epoch 42
Loss = 8.1131e-01, PNorm = 72.4274, GNorm = 1.7667, lr_0 = 9.8615e-04
Validation auc = 0.377378
Epoch 43
Validation auc = 0.448721
Epoch 44
Validation auc = 0.634977
Epoch 45
Validation auc = 0.578176
Epoch 46
Validation auc = 0.383884
Epoch 47
Loss = 6.9222e-01, PNorm = 72.7204, GNorm = 0.1416, lr_0 = 9.9977e-04
Validation auc = 0.545758
Epoch 48
Validation auc = 0.610540
Epoch 49
Validation auc = 0.634430
Epoch 50
Validation auc = 0.626941
Epoch 51
Loss = 6.7326e-01, PNorm = 72.9142, GNorm = 0.2493, lr_0 = 9.9954e-04
Loss = 6.2534e-01, PNorm = 72.9281, GNorm = 0.6584, lr_0 = 9.9952e-04
Validation auc = 0.582331
Epoch 52
Validation auc = 0.595670
Epoch 53
Validation auc = 0.622075
Epoch 54
Validation auc = 0.628471
Epoch 55
Validation auc = 0.630330
Epoch 56
Loss = 6.2388e-01, PNorm = 73.1406, GNorm = 0.2492, lr_0 = 9.9927e-04
Loss = 6.8819e-01, PNorm = 73.1539, GNorm = 1.0195, lr_0 = 9.9926e-04
Validation auc = 0.628745
Epoch 57
Validation auc = 0.626449
Epoch 58
Validation auc = 0.641975
Epoch 59
Validation auc = 0.610704
Epoch 60
Validation auc = 0.628581
Epoch 61
Loss = 6.6293e-01, PNorm = 73.3013, GNorm = 0.3930, lr_0 = 9.9903e-04
Validation auc = 0.591625
Epoch 62
Validation auc = 0.585885
Epoch 63
Validation auc = 0.587415
Epoch 64
Validation auc = 0.587470
Epoch 65
Validation auc = 0.577356
Epoch 66
Loss = 7.1437e-01, PNorm = 73.5038, GNorm = 0.3670, lr_0 = 9.9876e-04
Validation auc = 0.557894
Epoch 67
Validation auc = 0.552755
Epoch 68
Validation auc = 0.565493
Epoch 69
Validation auc = 0.576427
Epoch 70
Loss = 5.8429e-01, PNorm = 73.6504, GNorm = 0.5127, lr_0 = 9.9853e-04
Loss = 7.2836e-01, PNorm = 73.6564, GNorm = 1.0770, lr_0 = 9.9851e-04
Validation auc = 0.594686
Epoch 71
Validation auc = 0.619834
Epoch 72
Validation auc = 0.632736
Epoch 73
Validation auc = 0.631642
Epoch 74
Validation auc = 0.630276
Epoch 75
Loss = 5.9757e-01, PNorm = 73.7846, GNorm = 0.3459, lr_0 = 9.9828e-04
Validation auc = 0.620490
Epoch 76
Validation auc = 0.623059
Epoch 77
Validation auc = 0.626941
Epoch 78
Validation auc = 0.619396
Epoch 79
Validation auc = 0.616335
Epoch 80
Loss = 5.9750e-01, PNorm = 73.9369, GNorm = 0.5849, lr_0 = 9.9802e-04
Validation auc = 0.624590
Epoch 81
Validation auc = 0.620326
Epoch 82
Validation auc = 0.611415
Epoch 83
Validation auc = 0.616335
Epoch 84
Loss = 5.0896e-01, PNorm = 74.1150, GNorm = 0.7789, lr_0 = 9.9779e-04
Loss = 2.8286e-01, PNorm = 74.1319, GNorm = 0.9610, lr_0 = 9.9777e-04
Validation auc = 0.633774
Epoch 85
Validation auc = 0.636344
Epoch 86
Validation auc = 0.634977
Epoch 87
Validation auc = 0.613438
Epoch 88
Validation auc = 0.606604
Epoch 89
Loss = 5.4939e-01, PNorm = 74.3754, GNorm = 0.7153, lr_0 = 9.9752e-04
Loss = 8.8066e-01, PNorm = 74.3948, GNorm = 2.9624, lr_0 = 9.9750e-04
Validation auc = 0.634922
Epoch 90
Validation auc = 0.656353
Epoch 91
Validation auc = 0.632900
Epoch 92
Validation auc = 0.632353
Epoch 93
Validation auc = 0.633610
Epoch 94
Loss = 4.3265e-01, PNorm = 74.6341, GNorm = 0.5117, lr_0 = 9.9727e-04
Validation auc = 0.636672
Epoch 95
Validation auc = 0.630822
Epoch 96
Validation auc = 0.632845
Epoch 97
Validation auc = 0.637437
Epoch 98
Validation auc = 0.645309
Epoch 99
Loss = 5.3890e-01, PNorm = 74.9130, GNorm = 1.1590, lr_0 = 9.9701e-04
Validation auc = 0.653510
Epoch 100
Validation auc = 0.658430
Epoch 101
Validation auc = 0.662913
Epoch 102
Validation auc = 0.644872
Epoch 103
Loss = 6.3434e-01, PNorm = 75.1714, GNorm = 1.0683, lr_0 = 9.9678e-04
Loss = 4.3204e-01, PNorm = 75.1904, GNorm = 1.2919, lr_0 = 9.9676e-04
Validation auc = 0.662421
Epoch 104
Validation auc = 0.670129
Epoch 105
Validation auc = 0.676580
Epoch 106
Validation auc = 0.688006
Epoch 107
Validation auc = 0.683523
Epoch 108
Loss = 3.9786e-01, PNorm = 75.5087, GNorm = 0.4956, lr_0 = 9.9651e-04
Validation auc = 0.671168
Epoch 109
Validation auc = 0.688060
Epoch 110
Validation auc = 0.675159
Epoch 111
Validation auc = 0.669145
Epoch 112
Validation auc = 0.651214
Epoch 113
Loss = 3.6948e-01, PNorm = 75.7856, GNorm = 1.3289, lr_0 = 9.9627e-04
Validation auc = 0.653838
Epoch 114
Validation auc = 0.658102
Epoch 115
Validation auc = 0.681445
Epoch 116
Validation auc = 0.698393
Epoch 117
Loss = 3.7942e-01, PNorm = 76.0542, GNorm = 0.8201, lr_0 = 9.9604e-04
Loss = 4.7195e-01, PNorm = 76.0758, GNorm = 1.4516, lr_0 = 9.9602e-04
Validation auc = 0.691942
Epoch 118
Validation auc = 0.694183
Epoch 119
Validation auc = 0.730155
Epoch 120
Validation auc = 0.728515
Epoch 121
Validation auc = 0.731850
Epoch 122
Loss = 3.1403e-01, PNorm = 76.4255, GNorm = 1.1477, lr_0 = 9.9577e-04
Loss = 8.0003e-01, PNorm = 76.4417, GNorm = 4.7557, lr_0 = 9.9575e-04
Validation auc = 0.683250
Epoch 123
Validation auc = 0.650011
Epoch 124
Validation auc = 0.627050
Epoch 125
Validation auc = 0.619560
Epoch 126
Validation auc = 0.639351
Epoch 127
Loss = 2.6536e-01, PNorm = 76.7452, GNorm = 1.0965, lr_0 = 9.9552e-04
Validation auc = 0.664443
Epoch 128
Validation auc = 0.663842
Epoch 129
Validation auc = 0.643997
Epoch 130
Validation auc = 0.648043
Epoch 131
Validation auc = 0.647824
Epoch 132
Loss = 1.9301e-01, PNorm = 77.1652, GNorm = 1.3226, lr_0 = 9.9526e-04
Validation auc = 0.654056
Epoch 133
Validation auc = 0.650366
Epoch 134
Validation auc = 0.678767
Epoch 135
Validation auc = 0.685218
Epoch 136
Loss = 2.4123e-01, PNorm = 77.4995, GNorm = 1.5673, lr_0 = 9.9503e-04
Loss = 1.2519e-01, PNorm = 77.5224, GNorm = 1.0467, lr_0 = 9.9501e-04
Validation auc = 0.689427
Epoch 137
Validation auc = 0.709381
Epoch 138
Validation auc = 0.705281
Epoch 139
Validation auc = 0.697518
Epoch 140
Validation auc = 0.694238
Epoch 141
Loss = 2.8623e-01, PNorm = 77.8263, GNorm = 1.0124, lr_0 = 9.9477e-04
Validation auc = 0.696479
Epoch 142
Validation auc = 0.712224
Epoch 143
Validation auc = 0.728953
Epoch 144
Validation auc = 0.717855
Epoch 145
Validation auc = 0.700142
Epoch 146
Loss = 4.2034e-01, PNorm = 78.1299, GNorm = 3.1767, lr_0 = 9.9452e-04
Validation auc = 0.716543
Epoch 147
Validation auc = 0.714028
Epoch 148
Validation auc = 0.713153
Epoch 149
Validation auc = 0.712552
Epoch 150
Loss = 2.6414e-01, PNorm = 78.4429, GNorm = 1.2452, lr_0 = 9.9429e-04
Loss = 4.4587e-02, PNorm = 78.4653, GNorm = 0.4227, lr_0 = 9.9427e-04
Validation auc = 0.700634
Epoch 151
Validation auc = 0.694894
Epoch 152
Validation auc = 0.688443
Epoch 153
Validation auc = 0.683140
Epoch 154
Validation auc = 0.676361
Epoch 155
Loss = 2.0705e-01, PNorm = 78.7424, GNorm = 0.6392, lr_0 = 9.9403e-04
Loss = 8.9125e-02, PNorm = 78.7663, GNorm = 1.1152, lr_0 = 9.9401e-04
Validation auc = 0.677564
Epoch 156
Validation auc = 0.676635
Epoch 157
Validation auc = 0.664935
Epoch 158
Validation auc = 0.668052
Epoch 159
Validation auc = 0.666958
Epoch 160
Loss = 1.8048e-01, PNorm = 79.0565, GNorm = 1.6752, lr_0 = 9.9378e-04
Validation auc = 0.660015
Epoch 161
Validation auc = 0.661109
Epoch 162
Validation auc = 0.673136
Epoch 163
Validation auc = 0.682921
Epoch 164
Validation auc = 0.686256
Epoch 165
Loss = 1.2152e-01, PNorm = 79.3518, GNorm = 0.9067, lr_0 = 9.9351e-04
Validation auc = 0.690794
Epoch 166
Validation auc = 0.691286
Epoch 167
Validation auc = 0.686147
Epoch 168
Validation auc = 0.681063
Epoch 169
Loss = 1.3539e-01, PNorm = 79.5477, GNorm = 0.9933, lr_0 = 9.9329e-04
Loss = 1.8054e-02, PNorm = 79.5631, GNorm = 0.2336, lr_0 = 9.9327e-04
Validation auc = 0.680079
Epoch 170
Validation auc = 0.686038
Epoch 171
Validation auc = 0.712443
Epoch 172
Validation auc = 0.731249
Epoch 173
Validation auc = 0.750109
Epoch 174
Loss = 2.7756e-01, PNorm = 79.8962, GNorm = 1.6671, lr_0 = 9.9302e-04
Validation auc = 0.748141
Epoch 175
Validation auc = 0.741253
Epoch 176
Validation auc = 0.736387
Epoch 177
Validation auc = 0.722010
Epoch 178
Validation auc = 0.703914
Epoch 179
Loss = 1.9942e-01, PNorm = 80.2380, GNorm = 1.7317, lr_0 = 9.9277e-04
Validation auc = 0.701126
Epoch 180
Validation auc = 0.707686
Epoch 181
Validation auc = 0.708725
Epoch 182
Validation auc = 0.701290
Epoch 183
Loss = 6.4784e-02, PNorm = 80.4596, GNorm = 1.7348, lr_0 = 9.9253e-04
Validation auc = 0.689536
Epoch 184
Validation auc = 0.698885
Epoch 185
Validation auc = 0.702438
Epoch 186
Validation auc = 0.707140
Epoch 187
Validation auc = 0.713481
Epoch 188
Loss = 2.3183e-01, PNorm = 80.6932, GNorm = 1.1525, lr_0 = 9.9228e-04
Loss = 5.5140e-01, PNorm = 80.7107, GNorm = 2.8517, lr_0 = 9.9226e-04
Validation auc = 0.714739
Epoch 189
Validation auc = 0.707249
Epoch 190
Validation auc = 0.703422
Epoch 191
Validation auc = 0.686366
Epoch 192
Validation auc = 0.682976
Epoch 193
Loss = 1.6962e-01, PNorm = 80.9532, GNorm = 1.1676, lr_0 = 9.9204e-04
Validation auc = 0.686912
Epoch 194
Validation auc = 0.689755
Epoch 195
Validation auc = 0.686912
Epoch 196
Validation auc = 0.682183
Epoch 197
Validation auc = 0.684507
Epoch 198
Loss = 3.5653e-02, PNorm = 81.1911, GNorm = 0.2414, lr_0 = 9.9177e-04
Validation auc = 0.680407
Epoch 199
Validation auc = 0.669965
Epoch 200
Validation auc = 0.667122
Epoch 201
Validation auc = 0.666685
Epoch 202
Loss = 1.0331e-01, PNorm = 81.3553, GNorm = 1.1699, lr_0 = 9.9154e-04
Loss = 3.5580e-02, PNorm = 81.3666, GNorm = 1.2100, lr_0 = 9.9153e-04
Validation auc = 0.672316
Epoch 203
Validation auc = 0.683304
Epoch 204
Validation auc = 0.691942
Epoch 205
Validation auc = 0.702384
Epoch 206
Validation auc = 0.711568
Epoch 207
Loss = 3.2638e-02, PNorm = 81.4953, GNorm = 0.2901, lr_0 = 9.9128e-04
Loss = 2.2114e-03, PNorm = 81.5020, GNorm = 0.0477, lr_0 = 9.9126e-04
Validation auc = 0.714629
Epoch 208
Validation auc = 0.711076
Epoch 209
Validation auc = 0.706648
Epoch 210
Validation auc = 0.706429
Epoch 211
Validation auc = 0.710803
Epoch 212
Loss = 9.3666e-02, PNorm = 81.5650, GNorm = 1.3747, lr_0 = 9.9103e-04
Validation auc = 0.713099
Epoch 213
Validation auc = 0.712497
Epoch 214
Validation auc = 0.703641
Epoch 215
Validation auc = 0.691723
Epoch 216
Loss = 1.5440e-01, PNorm = 81.7766, GNorm = 1.5394, lr_0 = 9.9079e-04
Validation auc = 0.686147
Epoch 217
Validation auc = 0.703750
Epoch 218
Validation auc = 0.704734
Epoch 219
Validation auc = 0.707522
Epoch 220
Validation auc = 0.709217
Epoch 221
Loss = 1.3259e-01, PNorm = 82.0026, GNorm = 1.2393, lr_0 = 9.9054e-04
Loss = 4.5520e-02, PNorm = 82.0186, GNorm = 0.4310, lr_0 = 9.9052e-04
Validation auc = 0.722064
Epoch 222
Validation auc = 0.735239
Epoch 223
Validation auc = 0.729773
Epoch 224
Validation auc = 0.713973
Epoch 225
Validation auc = 0.695987
Epoch 226
Loss = 7.6452e-02, PNorm = 82.1871, GNorm = 0.2669, lr_0 = 9.9030e-04
Validation auc = 0.688416
Epoch 227
Validation auc = 0.688853
Epoch 228
Validation auc = 0.707003
Epoch 229
Validation auc = 0.707085
Epoch 230
Validation auc = 0.722720
Epoch 231
Loss = 1.0497e-01, PNorm = 82.3473, GNorm = 0.6396, lr_0 = 9.9003e-04
Validation auc = 0.721736
Epoch 232
Validation auc = 0.725071
Epoch 233
Validation auc = 0.723212
Epoch 234
Validation auc = 0.710365
Epoch 235
Loss = 1.0719e-01, PNorm = 82.4863, GNorm = 2.4522, lr_0 = 9.8980e-04
Loss = 8.8371e-02, PNorm = 82.4974, GNorm = 0.7877, lr_0 = 9.8979e-04
Validation auc = 0.721080
Epoch 236
Validation auc = 0.729773
Epoch 237
Validation auc = 0.733381
Epoch 238
Validation auc = 0.734037
Epoch 239
Validation auc = 0.728953
Epoch 240
Loss = 9.2534e-02, PNorm = 82.6636, GNorm = 0.5965, lr_0 = 9.8954e-04
Loss = 5.7388e-02, PNorm = 82.6775, GNorm = 1.3834, lr_0 = 9.8952e-04
Validation auc = 0.727586
Epoch 241
Validation auc = 0.724524
Epoch 242
Validation auc = 0.714083
Epoch 243
Validation auc = 0.707960
Epoch 244
Validation auc = 0.710693
Epoch 245
Loss = 2.6513e-01, PNorm = 82.8521, GNorm = 3.5239, lr_0 = 9.8930e-04
Validation auc = 0.711404
Epoch 246
Validation auc = 0.705773
Epoch 247
Validation auc = 0.698994
Epoch 248
Validation auc = 0.714301
Epoch 249
Loss = 4.5843e-02, PNorm = 83.0433, GNorm = 0.3119, lr_0 = 9.8905e-04
Validation auc = 0.721791
Epoch 250
Validation auc = 0.730538
Epoch 251
Validation auc = 0.739668
Epoch 252
Validation auc = 0.742456
Epoch 253
Validation auc = 0.735567
Epoch 254
Loss = 6.9623e-02, PNorm = 83.2411, GNorm = 0.3395, lr_0 = 9.8880e-04
Loss = 2.6129e-01, PNorm = 83.2550, GNorm = 2.1939, lr_0 = 9.8879e-04
Validation auc = 0.732725
Epoch 255
Validation auc = 0.727094
Epoch 256
Validation auc = 0.713153
Epoch 257
Validation auc = 0.712443
Epoch 258
Validation auc = 0.716543
Epoch 259
Loss = 2.6171e-02, PNorm = 83.4274, GNorm = 0.8707, lr_0 = 9.8856e-04
Validation auc = 0.702520
Epoch 260
Validation auc = 0.740050
Epoch 261
Validation auc = 0.749945
Epoch 262
Validation auc = 0.738192
Epoch 263
Validation auc = 0.741636
Epoch 264
Loss = 2.8695e-02, PNorm = 83.5631, GNorm = 1.4041, lr_0 = 9.8830e-04
Validation auc = 0.738520
Epoch 265
Validation auc = 0.734693
Epoch 266
Validation auc = 0.729062
Epoch 267
Validation auc = 0.726055
Epoch 268
Loss = 5.1122e-02, PNorm = 83.6310, GNorm = 0.0614, lr_0 = 9.8807e-04
Loss = 2.5300e-03, PNorm = 83.6336, GNorm = 0.0511, lr_0 = 9.8805e-04
Validation auc = 0.721627
Epoch 269
Validation auc = 0.718456
Epoch 270
Validation auc = 0.720534
Epoch 271
Validation auc = 0.717308
Epoch 272
Validation auc = 0.727750
Epoch 273
Loss = 2.6794e-02, PNorm = 83.6812, GNorm = 1.3591, lr_0 = 9.8781e-04
Loss = 8.5247e-04, PNorm = 83.6852, GNorm = 0.0161, lr_0 = 9.8779e-04
Validation auc = 0.735185
Epoch 274
Validation auc = 0.729718
Epoch 275
Validation auc = 0.725946
Epoch 276
Validation auc = 0.740160
Epoch 277
Validation auc = 0.760442
Epoch 278
Loss = 1.3852e-02, PNorm = 83.7564, GNorm = 0.6111, lr_0 = 9.8756e-04
Validation auc = 0.758692
Epoch 279
Validation auc = 0.731358
Epoch 280
Validation auc = 0.772031
Epoch 281
Validation auc = 0.779138
Epoch 282
Validation auc = 0.766455
Epoch 283
Loss = 1.9201e-01, PNorm = 83.9502, GNorm = 2.2607, lr_0 = 9.8730e-04
Validation auc = 0.732069
Epoch 284
Validation auc = 0.694347
Epoch 285
Validation auc = 0.675104
Epoch 286
Validation auc = 0.667560
Epoch 287
Loss = 2.6370e-01, PNorm = 84.2052, GNorm = 2.9754, lr_0 = 9.8707e-04
Loss = 2.5484e-01, PNorm = 84.2234, GNorm = 3.1370, lr_0 = 9.8705e-04
Validation auc = 0.684398
Epoch 288
Validation auc = 0.696534
Epoch 289
Validation auc = 0.700361
Epoch 290
Validation auc = 0.700908
Epoch 291
Validation auc = 0.698065
Epoch 292
Loss = 8.6170e-02, PNorm = 84.4671, GNorm = 0.8311, lr_0 = 9.8683e-04
Validation auc = 0.693418
Epoch 293
Validation auc = 0.689591
Epoch 294
Validation auc = 0.683578
Epoch 295
Validation auc = 0.679477
Epoch 296
Validation auc = 0.673190
Epoch 297
Loss = 2.6149e-02, PNorm = 84.6841, GNorm = 0.6361, lr_0 = 9.8656e-04
Validation auc = 0.671113
Epoch 298
Validation auc = 0.668052
Epoch 299
Validation auc = 0.671058
Epoch 300
Validation auc = 0.673628
Epoch 301
Loss = 6.2953e-02, PNorm = 84.8154, GNorm = 0.1453, lr_0 = 9.8634e-04
Loss = 2.5933e-01, PNorm = 84.8243, GNorm = 6.0845, lr_0 = 9.8632e-04
Validation auc = 0.677837
Epoch 302
Validation auc = 0.671742
Epoch 303
Validation auc = 0.685655
Epoch 304
Validation auc = 0.706593
Epoch 305
Validation auc = 0.727422
Epoch 306
Loss = 1.7819e-01, PNorm = 84.9597, GNorm = 1.8098, lr_0 = 9.8607e-04
Loss = 1.0171e-03, PNorm = 84.9667, GNorm = 0.0340, lr_0 = 9.8606e-04
Validation auc = 0.721299
Epoch 307
Validation auc = 0.715941
Epoch 308
Validation auc = 0.713044
Epoch 309
Validation auc = 0.723212
Epoch 310
Validation auc = 0.725891
Epoch 311
Loss = 3.1136e-02, PNorm = 85.0885, GNorm = 0.8370, lr_0 = 9.8583e-04
Validation auc = 0.727039
Epoch 312
Validation auc = 0.727613
Epoch 313
Validation auc = 0.722037
Epoch 314
Validation auc = 0.724907
Epoch 315
Validation auc = 0.724005
Epoch 316
Loss = 7.3485e-03, PNorm = 85.2512, GNorm = 0.1811, lr_0 = 9.8557e-04
Validation auc = 0.725563
Epoch 317
Validation auc = 0.735403
Epoch 318
Validation auc = 0.742510
Epoch 319
Validation auc = 0.748251
Epoch 320
Loss = 3.6600e-02, PNorm = 85.3146, GNorm = 0.1472, lr_0 = 9.8534e-04
Loss = 5.0601e-03, PNorm = 85.3197, GNorm = 0.0855, lr_0 = 9.8532e-04
Validation auc = 0.750219
Epoch 321
Validation auc = 0.746939
Epoch 322
Validation auc = 0.745955
Epoch 323
Validation auc = 0.744068
Epoch 324
Validation auc = 0.746829
Epoch 325
Loss = 5.5137e-02, PNorm = 85.3886, GNorm = 0.8321, lr_0 = 9.8509e-04
Validation auc = 0.745763
Epoch 326
Validation auc = 0.744752
Epoch 327
Validation auc = 0.743467
Epoch 328
Validation auc = 0.745462
Epoch 329
Validation auc = 0.748169
Epoch 330
Loss = 1.6335e-03, PNorm = 85.4556, GNorm = 0.0243, lr_0 = 9.8483e-04
Validation auc = 0.748196
Epoch 331
Validation auc = 0.747376
Epoch 332
Validation auc = 0.748606
Epoch 333
Validation auc = 0.753772
Epoch 334
Loss = 1.0471e-01, PNorm = 85.5114, GNorm = 0.5392, lr_0 = 9.8461e-04
Loss = 8.5025e-03, PNorm = 85.5171, GNorm = 0.1725, lr_0 = 9.8459e-04
Validation auc = 0.749809
Epoch 335
Validation auc = 0.742346
Epoch 336
Validation auc = 0.724032
Epoch 337
Validation auc = 0.703067
Epoch 338
Validation auc = 0.705226
Epoch 339
Loss = 2.1479e-02, PNorm = 85.6260, GNorm = 0.2277, lr_0 = 9.8434e-04
Loss = 5.8615e-03, PNorm = 85.6441, GNorm = 0.0925, lr_0 = 9.8433e-04
Validation auc = 0.691122
Epoch 340
Validation auc = 0.678220
Epoch 341
Validation auc = 0.680680
Epoch 342
Validation auc = 0.681609
Epoch 343
Validation auc = 0.672698
Epoch 344
Loss = 2.3839e-01, PNorm = 85.8495, GNorm = 1.3961, lr_0 = 9.8410e-04
Validation auc = 0.674721
Epoch 345
Validation auc = 0.685600
Epoch 346
Validation auc = 0.702165
Epoch 347
Validation auc = 0.706210
Epoch 348
Validation auc = 0.705609
Epoch 349
Loss = 2.1478e-01, PNorm = 86.0941, GNorm = 1.3688, lr_0 = 9.8384e-04
Validation auc = 0.688662
Epoch 350
Validation auc = 0.688880
Epoch 351
Validation auc = 0.683796
Epoch 352
Validation auc = 0.672425
Epoch 353
Loss = 2.7424e-02, PNorm = 86.3272, GNorm = 0.2304, lr_0 = 9.8361e-04
Loss = 5.6806e-03, PNorm = 86.3415, GNorm = 0.0997, lr_0 = 9.8359e-04
Validation auc = 0.640389
Epoch 354
Validation auc = 0.633118
Epoch 355
Validation auc = 0.660179
Epoch 356
Validation auc = 0.680461
Epoch 357
Validation auc = 0.690958
Epoch 358
Loss = 1.3171e-02, PNorm = 86.5991, GNorm = 0.3782, lr_0 = 9.8335e-04
Validation auc = 0.697354
Epoch 359
Validation auc = 0.700251
Epoch 360
Validation auc = 0.707577
Epoch 361
Validation auc = 0.705281
Epoch 362
Validation auc = 0.699158
Epoch 363
Loss = 4.4187e-02, PNorm = 86.8439, GNorm = 0.6177, lr_0 = 9.8311e-04
Validation auc = 0.694894
Epoch 364
Validation auc = 0.695331
Epoch 365
Validation auc = 0.699322
Epoch 366
Validation auc = 0.700634
Epoch 367
Loss = 5.4708e-02, PNorm = 86.9849, GNorm = 0.6832, lr_0 = 9.8288e-04
Loss = 1.3173e-02, PNorm = 86.9934, GNorm = 0.3045, lr_0 = 9.8286e-04
Validation auc = 0.698885
Epoch 368
Validation auc = 0.699759
Epoch 369
Validation auc = 0.699978
Epoch 370
Validation auc = 0.700415
Epoch 371
Validation auc = 0.699814
Epoch 372
Loss = 1.3255e-02, PNorm = 87.0934, GNorm = 0.6552, lr_0 = 9.8262e-04
Loss = 2.1848e-03, PNorm = 87.0995, GNorm = 0.0721, lr_0 = 9.8260e-04
Validation auc = 0.696698
Epoch 373
Validation auc = 0.697409
Epoch 374
Validation auc = 0.702056
Epoch 375
Validation auc = 0.705882
Epoch 376
Validation auc = 0.715395
Epoch 377
Loss = 1.2319e-02, PNorm = 87.1905, GNorm = 0.5271, lr_0 = 9.8237e-04
Validation auc = 0.723103
Epoch 378
Validation auc = 0.714465
Epoch 379
Validation auc = 0.706538
Epoch 380
Validation auc = 0.705117
Epoch 381
Validation auc = 0.709928
Epoch 382
Loss = 3.0254e-02, PNorm = 87.2717, GNorm = 1.2178, lr_0 = 9.8211e-04
Validation auc = 0.711295
Epoch 383
Validation auc = 0.708069
Epoch 384
Validation auc = 0.704188
Epoch 385
Validation auc = 0.704406
Epoch 386
Loss = 1.2481e-02, PNorm = 87.3103, GNorm = 0.1893, lr_0 = 9.8189e-04
Loss = 9.9203e-03, PNorm = 87.3145, GNorm = 0.1365, lr_0 = 9.8187e-04
Validation auc = 0.708889
Epoch 387
Validation auc = 0.711951
Epoch 388
Validation auc = 0.712115
Epoch 389
Validation auc = 0.711131
Epoch 390
Validation auc = 0.706648
Epoch 391
Loss = 1.0347e-02, PNorm = 87.3580, GNorm = 0.2219, lr_0 = 9.8163e-04
Validation auc = 0.699541
Epoch 392
Validation auc = 0.709053
Epoch 393
Validation auc = 0.741745
Epoch 394
Validation auc = 0.743768
Epoch 395
Validation auc = 0.742456
Epoch 396
Loss = 9.8856e-03, PNorm = 87.4369, GNorm = 0.2278, lr_0 = 9.8138e-04
Validation auc = 0.740542
Epoch 397
Validation auc = 0.736333
Epoch 398
Validation auc = 0.731959
Epoch 399
Validation auc = 0.726383
Epoch 400
Loss = 1.0782e-02, PNorm = 87.5196, GNorm = 0.3417, lr_0 = 9.8116e-04
Loss = 3.0773e-03, PNorm = 87.5247, GNorm = 0.0595, lr_0 = 9.8114e-04
Validation auc = 0.725782
Epoch 401
Validation auc = 0.728461
Epoch 402
Validation auc = 0.731522
Epoch 403
Validation auc = 0.737645
Epoch 404
Validation auc = 0.743713
Epoch 405
Loss = 4.9500e-02, PNorm = 87.5920, GNorm = 0.3706, lr_0 = 9.8089e-04
Loss = 5.5560e-03, PNorm = 87.5961, GNorm = 0.1260, lr_0 = 9.8088e-04
Validation auc = 0.746173
Epoch 406
Validation auc = 0.740488
Epoch 407
Validation auc = 0.730210
Epoch 408
Validation auc = 0.711732
Epoch 409
Validation auc = 0.722174
Epoch 410
Loss = 1.8739e-01, PNorm = 87.6516, GNorm = 1.2968, lr_0 = 9.8065e-04
Validation auc = 0.737864
Epoch 411
Validation auc = 0.752952
Epoch 412
Validation auc = 0.760278
Epoch 413
Validation auc = 0.766565
Epoch 414
Validation auc = 0.767057
Epoch 415
Loss = 7.3583e-02, PNorm = 87.8206, GNorm = 0.6325, lr_0 = 9.8039e-04
Validation auc = 0.761262
Epoch 416
Validation auc = 0.759458
Epoch 417
Validation auc = 0.755303
Epoch 418
Validation auc = 0.751749
Epoch 419
Loss = 3.9914e-02, PNorm = 87.9610, GNorm = 0.2961, lr_0 = 9.8016e-04
Loss = 2.7218e-03, PNorm = 87.9714, GNorm = 0.0639, lr_0 = 9.8015e-04
Validation auc = 0.746228
Epoch 420
Validation auc = 0.735130
Epoch 421
Validation auc = 0.729335
Epoch 422
Validation auc = 0.722556
Epoch 423
Validation auc = 0.705527
Epoch 424
Loss = 4.5966e-01, PNorm = 88.1492, GNorm = 10.5154, lr_0 = 9.7990e-04
Validation auc = 0.721736
Epoch 425
Validation auc = 0.743221
Epoch 426
Validation auc = 0.753936
Epoch 427
Validation auc = 0.768478
Epoch 428
Validation auc = 0.779029
Epoch 429
Loss = 1.7313e-02, PNorm = 88.4563, GNorm = 0.4741, lr_0 = 9.7966e-04
Validation auc = 0.770610
Epoch 430
Validation auc = 0.766237
Epoch 431
Validation auc = 0.761535
Epoch 432
Validation auc = 0.751695
Epoch 433
Loss = 7.2097e-02, PNorm = 88.6946, GNorm = 0.2738, lr_0 = 9.7942e-04
Validation auc = 0.740160
Epoch 434
Validation auc = 0.736223
Epoch 435
Validation auc = 0.733162
Epoch 436
Validation auc = 0.729663
Epoch 437
Validation auc = 0.722720
Epoch 438
Loss = 9.5921e-02, PNorm = 88.8415, GNorm = 0.0494, lr_0 = 9.7917e-04
Loss = 3.0542e-04, PNorm = 88.8489, GNorm = 0.0072, lr_0 = 9.7916e-04
Validation auc = 0.716324
Epoch 439
Validation auc = 0.710803
Epoch 440
Validation auc = 0.704953
Epoch 441
Validation auc = 0.704188
Epoch 442
Validation auc = 0.705828
Epoch 443
Loss = 1.9136e-02, PNorm = 88.9174, GNorm = 0.4131, lr_0 = 9.7893e-04
Validation auc = 0.705937
Epoch 444
Validation auc = 0.705500
Epoch 445
Validation auc = 0.705336
Epoch 446
Validation auc = 0.706265
Epoch 447
Validation auc = 0.707358
Epoch 448
Loss = 7.1089e-03, PNorm = 88.9700, GNorm = 0.5266, lr_0 = 9.7867e-04
Validation auc = 0.709053
Epoch 449
Validation auc = 0.708178
Epoch 450
Validation auc = 0.708944
Epoch 451
Validation auc = 0.709983
Epoch 452
Loss = 5.2469e-03, PNorm = 89.0064, GNorm = 0.1531, lr_0 = 9.7845e-04
Loss = 1.2751e-03, PNorm = 89.0091, GNorm = 0.0309, lr_0 = 9.7843e-04
Validation auc = 0.711349
Epoch 453
Validation auc = 0.713044
Epoch 454
Validation auc = 0.716925
Epoch 455
Validation auc = 0.722283
Epoch 456
Validation auc = 0.725563
Epoch 457
Loss = 1.3593e-03, PNorm = 89.0501, GNorm = 0.0816, lr_0 = 9.7819e-04
Loss = 3.0255e-03, PNorm = 89.0532, GNorm = 0.1322, lr_0 = 9.7817e-04
Validation auc = 0.729718
Epoch 458
Validation auc = 0.732123
Epoch 459
Validation auc = 0.734091
Epoch 460
Validation auc = 0.729226
Epoch 461
Validation auc = 0.735895
Epoch 462
Loss = 3.8366e-01, PNorm = 89.0733, GNorm = 7.8414, lr_0 = 9.7794e-04
Validation auc = 0.731795
Epoch 463
Validation auc = 0.734638
Epoch 464
Validation auc = 0.737426
Epoch 465
Validation auc = 0.722228
Epoch 466
Loss = 3.6183e-02, PNorm = 89.2615, GNorm = 0.1412, lr_0 = 9.7770e-04
Validation auc = 0.710857
Epoch 467
Validation auc = 0.709272
Epoch 468
Validation auc = 0.709436
Epoch 469
Validation auc = 0.710748
Epoch 470
Validation auc = 0.711459
Epoch 471
Loss = 5.7969e-02, PNorm = 89.5141, GNorm = 1.1902, lr_0 = 9.7746e-04
Loss = 3.7069e-02, PNorm = 89.5341, GNorm = 0.5231, lr_0 = 9.7744e-04
Validation auc = 0.708561
Epoch 472
Validation auc = 0.711896
Epoch 473
Validation auc = 0.715504
Epoch 474
Validation auc = 0.714957
Epoch 475
Validation auc = 0.711732
Epoch 476
Loss = 2.6034e-02, PNorm = 89.7471, GNorm = 0.4565, lr_0 = 9.7721e-04
Validation auc = 0.707358
Epoch 477
Validation auc = 0.700798
Epoch 478
Validation auc = 0.701782
Epoch 479
Validation auc = 0.708506
Epoch 480
Validation auc = 0.708178
Epoch 481
Loss = 8.3671e-02, PNorm = 89.9164, GNorm = 1.0283, lr_0 = 9.7695e-04
Validation auc = 0.712005
Epoch 482
Validation auc = 0.712716
Epoch 483
Validation auc = 0.714848
Epoch 484
Validation auc = 0.721354
Epoch 485
Loss = 1.3903e-02, PNorm = 89.9935, GNorm = 0.5763, lr_0 = 9.7673e-04
Loss = 1.0965e-02, PNorm = 90.0000, GNorm = 0.6796, lr_0 = 9.7671e-04
Validation auc = 0.726219
Epoch 486
Validation auc = 0.728570
Epoch 487
Validation auc = 0.731686
Epoch 488
Validation auc = 0.734365
Epoch 489
Validation auc = 0.735185
Epoch 490
Loss = 9.0315e-03, PNorm = 90.0625, GNorm = 0.2403, lr_0 = 9.7647e-04
Loss = 2.2302e-02, PNorm = 90.0675, GNorm = 0.7080, lr_0 = 9.7645e-04
Validation auc = 0.733545
Epoch 491
Validation auc = 0.729773
Epoch 492
Validation auc = 0.729062
Epoch 493
Validation auc = 0.727805
Epoch 494
Validation auc = 0.724962
Epoch 495
Loss = 8.0257e-03, PNorm = 90.1157, GNorm = 0.1834, lr_0 = 9.7623e-04
Validation auc = 0.723868
Epoch 496
Validation auc = 0.722611
Epoch 497
Validation auc = 0.720315
Epoch 498
Validation auc = 0.719823
Epoch 499
Loss = 2.4303e-03, PNorm = 90.1673, GNorm = 0.0148, lr_0 = 9.7599e-04
Validation auc = 0.717909
Epoch 500
Validation auc = 0.720916
Epoch 501
Validation auc = 0.720151
Epoch 502
Validation auc = 0.719550
Epoch 503
Validation auc = 0.720643
Epoch 504
Loss = 6.4103e-03, PNorm = 90.2137, GNorm = 0.2613, lr_0 = 9.7574e-04
Loss = 7.4384e-04, PNorm = 90.2202, GNorm = 0.0220, lr_0 = 9.7573e-04
Validation auc = 0.721244
Epoch 505
Validation auc = 0.721791
Epoch 506
Validation auc = 0.724087
Epoch 507
Validation auc = 0.721736
Epoch 508
Validation auc = 0.720315
Epoch 509
Loss = 2.4373e-01, PNorm = 90.2900, GNorm = 0.7766, lr_0 = 9.7550e-04
Validation auc = 0.718237
Epoch 510
Validation auc = 0.716980
Epoch 511
Validation auc = 0.716051
Epoch 512
Validation auc = 0.717035
Epoch 513
Validation auc = 0.717253
Epoch 514
Loss = 4.4076e-03, PNorm = 90.3502, GNorm = 0.0627, lr_0 = 9.7524e-04
Validation auc = 0.718128
Epoch 515
Validation auc = 0.720151
Epoch 516
Validation auc = 0.719331
Epoch 517
Validation auc = 0.720479
Epoch 518
Loss = 1.3342e-02, PNorm = 90.4091, GNorm = 0.1963, lr_0 = 9.7502e-04
Loss = 9.2097e-04, PNorm = 90.4135, GNorm = 0.0182, lr_0 = 9.7500e-04
Validation auc = 0.723814
Epoch 519
Validation auc = 0.726274
Epoch 520
Validation auc = 0.725508
Epoch 521
Validation auc = 0.725618
Epoch 522
Validation auc = 0.731249
Epoch 523
Loss = 3.5555e-02, PNorm = 90.4569, GNorm = 0.0094, lr_0 = 9.7476e-04
Loss = 7.1136e-04, PNorm = 90.4591, GNorm = 0.0163, lr_0 = 9.7474e-04
Validation auc = 0.729827
Epoch 524
Validation auc = 0.730210
Epoch 525
Validation auc = 0.731959
Epoch 526
Validation auc = 0.732998
Epoch 527
Validation auc = 0.734583
Epoch 528
Loss = 1.6785e-02, PNorm = 90.5134, GNorm = 1.5596, lr_0 = 9.7452e-04
Validation auc = 0.730921
Epoch 529
Validation auc = 0.729335
Epoch 530
Validation auc = 0.741690
Epoch 531
Validation auc = 0.744970
Epoch 532
Validation auc = 0.745244
Epoch 533
Loss = 1.0361e-02, PNorm = 90.5685, GNorm = 0.6639, lr_0 = 9.7426e-04
Validation auc = 0.749781
Epoch 534
Validation auc = 0.750383
Epoch 535
Validation auc = 0.761972
Epoch 536
Validation auc = 0.765963
Epoch 537
Loss = 2.0715e-02, PNorm = 90.6899, GNorm = 0.6316, lr_0 = 9.7403e-04
Loss = 1.8659e-03, PNorm = 90.7048, GNorm = 0.0318, lr_0 = 9.7401e-04
Validation auc = 0.767002
Epoch 538
Validation auc = 0.764651
Epoch 539
Validation auc = 0.759075
Epoch 540
Validation auc = 0.746337
Epoch 541
Validation auc = 0.742729
Epoch 542
Loss = 1.6984e-01, PNorm = 90.8642, GNorm = 1.3906, lr_0 = 9.7379e-04
Validation auc = 0.736387
Epoch 543
Validation auc = 0.732397
Epoch 544
Validation auc = 0.727531
Epoch 545
Validation auc = 0.723868
Epoch 546
Validation auc = 0.721955
Epoch 547
Loss = 1.6409e-02, PNorm = 91.0702, GNorm = 0.3830, lr_0 = 9.7353e-04
Validation auc = 0.719823
Epoch 548
Validation auc = 0.718511
Epoch 549
Validation auc = 0.715449
Epoch 550
Validation auc = 0.709873
Epoch 551
Loss = 8.9953e-03, PNorm = 91.1792, GNorm = 0.4416, lr_0 = 9.7331e-04
Loss = 1.8396e-02, PNorm = 91.1861, GNorm = 0.5336, lr_0 = 9.7329e-04
Validation auc = 0.709326
Epoch 552
Validation auc = 0.715067
Epoch 553
Validation auc = 0.727094
Epoch 554
Validation auc = 0.739558
Epoch 555
Validation auc = 0.747212
Epoch 556
Loss = 2.7342e-03, PNorm = 91.2610, GNorm = 0.0232, lr_0 = 9.7305e-04
Loss = 1.6619e-03, PNorm = 91.2653, GNorm = 0.0427, lr_0 = 9.7303e-04
Validation auc = 0.748852
Epoch 557
Validation auc = 0.742729
Epoch 558
Validation auc = 0.724470
Epoch 559
Validation auc = 0.722556
Epoch 560
Validation auc = 0.743330
Epoch 561
Loss = 9.6731e-03, PNorm = 91.3445, GNorm = 0.1748, lr_0 = 9.7281e-04
Validation auc = 0.757326
Epoch 562
Validation auc = 0.758638
Epoch 563
Validation auc = 0.745298
Epoch 564
Validation auc = 0.743822
Epoch 565
Validation auc = 0.741690
Epoch 566
Loss = 3.4517e-02, PNorm = 91.4845, GNorm = 0.6294, lr_0 = 9.7255e-04
Validation auc = 0.740160
Epoch 567
Validation auc = 0.740652
Epoch 568
Validation auc = 0.739996
Epoch 569
Validation auc = 0.738629
Epoch 570
Loss = 1.7416e-02, PNorm = 91.6024, GNorm = 1.8717, lr_0 = 9.7232e-04
Loss = 6.8788e-03, PNorm = 91.6082, GNorm = 0.3406, lr_0 = 9.7231e-04
Validation auc = 0.736497
Epoch 571
Validation auc = 0.732397
Epoch 572
Validation auc = 0.730702
Epoch 573
Validation auc = 0.723431
Epoch 574
Validation auc = 0.729226
Epoch 575
Loss = 1.1022e-02, PNorm = 91.6729, GNorm = 0.1724, lr_0 = 9.7208e-04
Validation auc = 0.763011
Epoch 576
Validation auc = 0.781763
Epoch 577
Validation auc = 0.778920
Epoch 578
Validation auc = 0.790127
Epoch 579
Validation auc = 0.795102
Epoch 580
Loss = 1.9743e-01, PNorm = 91.8866, GNorm = 1.0327, lr_0 = 9.7182e-04
Validation auc = 0.791712
Epoch 581
Validation auc = 0.786901
Epoch 582
Validation auc = 0.778318
Epoch 583
Validation auc = 0.775640
Epoch 584
Loss = 2.7630e-02, PNorm = 92.1018, GNorm = 0.3793, lr_0 = 9.7160e-04
Loss = 2.9184e-03, PNorm = 92.1139, GNorm = 0.0573, lr_0 = 9.7158e-04
Validation auc = 0.772141
Epoch 585
Validation auc = 0.767549
Epoch 586
Validation auc = 0.765307
Epoch 587
Validation auc = 0.764542
Epoch 588
Validation auc = 0.768314
Epoch 589
Loss = 9.1045e-02, PNorm = 92.2506, GNorm = 0.1276, lr_0 = 9.7134e-04
Loss = 4.2004e-03, PNorm = 92.2589, GNorm = 0.0799, lr_0 = 9.7132e-04
Validation auc = 0.777116
Epoch 590
Validation auc = 0.785699
Epoch 591
Validation auc = 0.794774
Epoch 592
Validation auc = 0.803247
Epoch 593
Validation auc = 0.810737
Epoch 594
Loss = 2.3958e-02, PNorm = 92.3514, GNorm = 0.5491, lr_0 = 9.7110e-04
Validation auc = 0.813525
Epoch 595
Validation auc = 0.811776
Epoch 596
Validation auc = 0.809425
Epoch 597
Validation auc = 0.799421
Epoch 598
Validation auc = 0.791166
Epoch 599
Loss = 1.3850e-02, PNorm = 92.4662, GNorm = 0.2622, lr_0 = 9.7084e-04
Validation auc = 0.798928
Epoch 600
Validation auc = 0.810901
Epoch 601
Validation auc = 0.818281
Epoch 602
Validation auc = 0.821452
Epoch 603
Loss = 5.3338e-02, PNorm = 92.5384, GNorm = 0.1848, lr_0 = 9.7062e-04
Loss = 3.5685e-04, PNorm = 92.5415, GNorm = 0.0073, lr_0 = 9.7060e-04
Validation auc = 0.821179
Epoch 604
Validation auc = 0.821015
Epoch 605
Validation auc = 0.818336
Epoch 606
Validation auc = 0.813798
Epoch 607
Validation auc = 0.809917
Epoch 608
Loss = 4.0462e-03, PNorm = 92.5816, GNorm = 0.0303, lr_0 = 9.7036e-04
Validation auc = 0.808168
Epoch 609
Validation auc = 0.797999
Epoch 610
Validation auc = 0.779794
Epoch 611
Validation auc = 0.770610
Epoch 612
Validation auc = 0.769079
Epoch 613
Loss = 1.4440e-01, PNorm = 92.6473, GNorm = 0.8030, lr_0 = 9.7012e-04
Validation auc = 0.776186
Epoch 614
Validation auc = 0.782200
Epoch 615
Validation auc = 0.796468
Epoch 616
Validation auc = 0.806855
Epoch 617
Loss = 1.5889e-02, PNorm = 92.6811, GNorm = 0.2333, lr_0 = 9.6990e-04
Loss = 7.1665e-03, PNorm = 92.6837, GNorm = 0.1235, lr_0 = 9.6988e-04
Validation auc = 0.812924
Epoch 618
Validation auc = 0.816422
Epoch 619
Validation auc = 0.818117
Epoch 620
Validation auc = 0.819539
Epoch 621
Validation auc = 0.821015
Epoch 622
Loss = 8.7204e-03, PNorm = 92.7328, GNorm = 0.0777, lr_0 = 9.6964e-04
Loss = 2.4806e-03, PNorm = 92.7363, GNorm = 0.0400, lr_0 = 9.6962e-04
Validation auc = 0.821944
Epoch 623
Validation auc = 0.823256
Epoch 624
Validation auc = 0.822327
Epoch 625
Validation auc = 0.813252
Epoch 626
Validation auc = 0.807019
Epoch 627
Loss = 1.7369e-02, PNorm = 92.7803, GNorm = 0.7311, lr_0 = 9.6940e-04
Validation auc = 0.802045
Epoch 628
Validation auc = 0.797671
Epoch 629
Validation auc = 0.794719
Epoch 630
Validation auc = 0.793790
Epoch 631
Validation auc = 0.794282
Epoch 632
Loss = 9.5611e-03, PNorm = 92.8288, GNorm = 0.6945, lr_0 = 9.6914e-04
Validation auc = 0.790346
Epoch 633
Validation auc = 0.787831
Epoch 634
Validation auc = 0.791658
Epoch 635
Validation auc = 0.793024
Epoch 636
Loss = 3.7018e-03, PNorm = 92.8650, GNorm = 0.0367, lr_0 = 9.6892e-04
Loss = 8.8022e-04, PNorm = 92.8683, GNorm = 0.0251, lr_0 = 9.6890e-04
Validation auc = 0.793079
Epoch 637
Validation auc = 0.792478
Epoch 638
Validation auc = 0.791002
Epoch 639
Validation auc = 0.789908
Epoch 640
Validation auc = 0.787940
Epoch 641
Loss = 1.8489e-02, PNorm = 92.8977, GNorm = 0.8638, lr_0 = 9.6866e-04
Validation auc = 0.784933
Epoch 642
Validation auc = 0.781435
Epoch 643
Validation auc = 0.778373
Epoch 644
Validation auc = 0.775148
Epoch 645
Validation auc = 0.774109
Epoch 646
Loss = 3.4615e-03, PNorm = 92.9338, GNorm = 0.0768, lr_0 = 9.6842e-04
Validation auc = 0.772961
Epoch 647
Validation auc = 0.771922
Epoch 648
Validation auc = 0.770227
Epoch 649
Validation auc = 0.767002
Epoch 650
Loss = 1.9407e-02, PNorm = 92.9558, GNorm = 1.1402, lr_0 = 9.6820e-04
Loss = 3.4693e-04, PNorm = 92.9583, GNorm = 0.0091, lr_0 = 9.6818e-04
Validation auc = 0.758966
Epoch 651
Validation auc = 0.751312
Epoch 652
Validation auc = 0.749125
Epoch 653
Validation auc = 0.764651
Epoch 654
Validation auc = 0.770883
Epoch 655
Loss = 2.3798e-03, PNorm = 92.9844, GNorm = 0.0734, lr_0 = 9.6794e-04
Loss = 1.1995e-03, PNorm = 92.9866, GNorm = 0.0647, lr_0 = 9.6792e-04
Validation auc = 0.773781
Epoch 656
Validation auc = 0.775640
Epoch 657
Validation auc = 0.778428
Epoch 658
Validation auc = 0.782528
Epoch 659
Validation auc = 0.780341
Epoch 660
Loss = 2.8589e-03, PNorm = 93.0198, GNorm = 0.1345, lr_0 = 9.6770e-04
Validation auc = 0.779193
Epoch 661
Validation auc = 0.773180
Epoch 662
Validation auc = 0.764651
Epoch 663
Validation auc = 0.758747
Epoch 664
Validation auc = 0.755740
Epoch 665
Loss = 1.3303e-03, PNorm = 93.0592, GNorm = 0.0409, lr_0 = 9.6744e-04
Validation auc = 0.754319
Epoch 666
Validation auc = 0.756123
Epoch 667
Validation auc = 0.757654
Epoch 668
Validation auc = 0.758091
Epoch 669
Loss = 2.7134e-04, PNorm = 93.0866, GNorm = 0.0254, lr_0 = 9.6722e-04
Loss = 5.4090e-04, PNorm = 93.0881, GNorm = 0.0155, lr_0 = 9.6720e-04
Validation auc = 0.758692
Epoch 670
Validation auc = 0.759895
Epoch 671
Validation auc = 0.760551
Epoch 672
Validation auc = 0.758856
Epoch 673
Validation auc = 0.757216
Epoch 674
Loss = 1.2039e-02, PNorm = 93.0934, GNorm = 0.0274, lr_0 = 9.6696e-04
Validation auc = 0.753225
Epoch 675
Validation auc = 0.745298
Epoch 676
Validation auc = 0.736934
Epoch 677
Validation auc = 0.743768
Epoch 678
Validation auc = 0.761371
Epoch 679
Loss = 3.6975e-02, PNorm = 93.1982, GNorm = 0.8127, lr_0 = 9.6672e-04
Validation auc = 0.768314
Epoch 680
Validation auc = 0.763394
Epoch 681
Validation auc = 0.763777
Epoch 682
Validation auc = 0.763995
Epoch 683
Loss = 3.6077e-02, PNorm = 93.3590, GNorm = 0.1960, lr_0 = 9.6648e-04
Validation auc = 0.759294
Epoch 684
Validation auc = 0.747376
Epoch 685
Validation auc = 0.734310
Epoch 686
Validation auc = 0.724251
Epoch 687
Validation auc = 0.715559
Epoch 688
Loss = 2.5074e-03, PNorm = 93.5148, GNorm = 0.0685, lr_0 = 9.6624e-04
Loss = 3.6625e-03, PNorm = 93.5226, GNorm = 0.1353, lr_0 = 9.6622e-04
Validation auc = 0.709381
Epoch 689
Validation auc = 0.711131
Epoch 690
Validation auc = 0.718675
Epoch 691
Validation auc = 0.718894
Epoch 692
Validation auc = 0.723158
Epoch 693
Loss = 1.4096e-02, PNorm = 93.5942, GNorm = 1.1432, lr_0 = 9.6600e-04
Validation auc = 0.727312
Epoch 694
Validation auc = 0.722720
Epoch 695
Validation auc = 0.726055
Epoch 696
Validation auc = 0.728023
Epoch 697
Validation auc = 0.730921
Epoch 698
Loss = 9.8890e-02, PNorm = 93.7323, GNorm = 1.5925, lr_0 = 9.6574e-04
Validation auc = 0.732834
Epoch 699
Validation auc = 0.735185
Epoch 700
Validation auc = 0.737426
Epoch 701
Validation auc = 0.737918
Epoch 702
Loss = 9.9967e-04, PNorm = 93.8244, GNorm = 0.0209, lr_0 = 9.6552e-04
Loss = 1.6254e-03, PNorm = 93.8300, GNorm = 0.1062, lr_0 = 9.6550e-04
Validation auc = 0.738957
Epoch 703
Validation auc = 0.739941
Epoch 704
Validation auc = 0.734966
Epoch 705
Validation auc = 0.733326
Epoch 706
Validation auc = 0.732615
Epoch 707
Loss = 3.0224e-03, PNorm = 93.8598, GNorm = 0.0514, lr_0 = 9.6526e-04
Loss = 6.6908e-05, PNorm = 93.8626, GNorm = 0.0024, lr_0 = 9.6525e-04
Validation auc = 0.731467
Epoch 708
Validation auc = 0.730702
Epoch 709
Validation auc = 0.730647
Epoch 710
Validation auc = 0.726219
Epoch 711
Validation auc = 0.725290
Epoch 712
Loss = 3.1997e-03, PNorm = 93.8995, GNorm = 0.0857, lr_0 = 9.6502e-04
Validation auc = 0.725891
Epoch 713
Validation auc = 0.733217
Epoch 714
Validation auc = 0.738629
Epoch 715
Validation auc = 0.736934
Epoch 716
Loss = 8.0288e-04, PNorm = 93.9589, GNorm = 0.0451, lr_0 = 9.6479e-04
Validation auc = 0.721900
Epoch 717
Validation auc = 0.713919
Epoch 718
Validation auc = 0.705390
Epoch 719
Validation auc = 0.705773
Epoch 720
Validation auc = 0.707960
Epoch 721
Loss = 1.4362e-03, PNorm = 94.0081, GNorm = 0.0208, lr_0 = 9.6455e-04
Loss = 1.5938e-04, PNorm = 94.0109, GNorm = 0.0039, lr_0 = 9.6453e-04
Validation auc = 0.709217
Epoch 722
Validation auc = 0.711076
Epoch 723
Validation auc = 0.708944
Epoch 724
Validation auc = 0.705500
Epoch 725
Validation auc = 0.704078
Epoch 726
Loss = 7.3138e-03, PNorm = 94.0306, GNorm = 0.4818, lr_0 = 9.6431e-04
Validation auc = 0.703368
Epoch 727
Validation auc = 0.704406
Epoch 728
Validation auc = 0.705117
Epoch 729
Validation auc = 0.707468
Epoch 730
Validation auc = 0.706702
Epoch 731
Loss = 5.7282e-03, PNorm = 94.0639, GNorm = 0.1229, lr_0 = 9.6405e-04
Validation auc = 0.708725
Epoch 732
Validation auc = 0.711896
Epoch 733
Validation auc = 0.714575
Epoch 734
Validation auc = 0.716871
Epoch 735
Loss = 4.9596e-02, PNorm = 94.0948, GNorm = 0.0191, lr_0 = 9.6383e-04
Loss = 5.6423e-04, PNorm = 94.0971, GNorm = 0.0148, lr_0 = 9.6381e-04
Validation auc = 0.715613
Epoch 736
Validation auc = 0.715887
Epoch 737
Validation auc = 0.713864
Epoch 738
Validation auc = 0.711787
Epoch 739
Validation auc = 0.710693
Epoch 740
Loss = 4.4428e-03, PNorm = 94.1322, GNorm = 0.0405, lr_0 = 9.6357e-04
Loss = 6.2218e-03, PNorm = 94.1344, GNorm = 0.1443, lr_0 = 9.6355e-04
Validation auc = 0.709764
Epoch 741
Validation auc = 0.713427
Epoch 742
Validation auc = 0.720096
Epoch 743
Validation auc = 0.722666
Epoch 744
Validation auc = 0.725399
Epoch 745
Loss = 1.6851e-03, PNorm = 94.1645, GNorm = 0.0399, lr_0 = 9.6333e-04
Validation auc = 0.722283
Epoch 746
Validation auc = 0.720424
Epoch 747
Validation auc = 0.720698
Epoch 748
Validation auc = 0.724306
Epoch 749
Loss = 1.3600e-03, PNorm = 94.2553, GNorm = 0.0125, lr_0 = 9.6309e-04
Validation auc = 0.728461
Epoch 750
Validation auc = 0.732506
Epoch 751
Validation auc = 0.736059
Epoch 752
Validation auc = 0.739558
Epoch 753
Validation auc = 0.741690
Epoch 754
Loss = 8.3071e-04, PNorm = 94.3037, GNorm = 0.0171, lr_0 = 9.6285e-04
Loss = 3.1192e-05, PNorm = 94.3054, GNorm = 0.0010, lr_0 = 9.6284e-04
Validation auc = 0.742784
Epoch 755
Validation auc = 0.740706
Epoch 756
Validation auc = 0.739777
Epoch 757
Validation auc = 0.738684
Epoch 758
Validation auc = 0.738902
Epoch 759
Loss = 9.0601e-04, PNorm = 94.3268, GNorm = 0.0133, lr_0 = 9.6262e-04
Validation auc = 0.741362
Epoch 760
Validation auc = 0.741745
Epoch 761
Validation auc = 0.742510
Epoch 762
Validation auc = 0.743112
Epoch 763
Validation auc = 0.744588
Epoch 764
Loss = 1.0389e-02, PNorm = 94.3451, GNorm = 0.6899, lr_0 = 9.6236e-04
Validation auc = 0.744314
Epoch 765
Validation auc = 0.742784
Epoch 766
Validation auc = 0.742292
Epoch 767
Validation auc = 0.742674
Epoch 768
Loss = 2.6367e-03, PNorm = 94.3741, GNorm = 0.0496, lr_0 = 9.6214e-04
Loss = 5.5898e-04, PNorm = 94.3762, GNorm = 0.0198, lr_0 = 9.6212e-04
Validation auc = 0.743822
Epoch 769
Validation auc = 0.744588
Epoch 770
Validation auc = 0.745298
Epoch 771
Validation auc = 0.744916
Epoch 772
Validation auc = 0.745080
Epoch 773
Loss = 5.5015e-02, PNorm = 94.3976, GNorm = 0.8420, lr_0 = 9.6188e-04
Loss = 1.0031e-03, PNorm = 94.3975, GNorm = 0.0439, lr_0 = 9.6186e-04
Validation auc = 0.745353
Epoch 774
Validation auc = 0.739668
Epoch 775
Validation auc = 0.735458
Epoch 776
Validation auc = 0.733435
Epoch 777
Validation auc = 0.732943
Epoch 778
Loss = 9.0184e-04, PNorm = 94.4132, GNorm = 0.0259, lr_0 = 9.6164e-04
Validation auc = 0.732069
Epoch 779
Validation auc = 0.731850
Epoch 780
Validation auc = 0.732069
Epoch 781
Validation auc = 0.731959
Epoch 782
Validation auc = 0.732561
Epoch 783
Loss = 2.0067e-03, PNorm = 94.4385, GNorm = 0.0484, lr_0 = 9.6139e-04
Validation auc = 0.732889
Epoch 784
Validation auc = 0.733545
Epoch 785
Validation auc = 0.733927
Epoch 786
Validation auc = 0.734365
Epoch 787
Loss = 4.1705e-04, PNorm = 94.4564, GNorm = 0.0097, lr_0 = 9.6117e-04
Loss = 4.8066e-04, PNorm = 94.4574, GNorm = 0.0122, lr_0 = 9.6115e-04
Validation auc = 0.734201
Epoch 788
Validation auc = 0.730210
Epoch 789
Validation auc = 0.718019
Epoch 790
Validation auc = 0.734966
Epoch 791
Validation auc = 0.745791
Epoch 792
Loss = 1.1299e-01, PNorm = 94.4923, GNorm = 1.0774, lr_0 = 9.6093e-04
Validation auc = 0.750984
Epoch 793
Validation auc = 0.754209
Epoch 794
Validation auc = 0.757599
Epoch 795
Validation auc = 0.766619
Epoch 796
Validation auc = 0.769025
Epoch 797
Loss = 4.2010e-03, PNorm = 94.5714, GNorm = 0.0909, lr_0 = 9.6067e-04
Validation auc = 0.765253
Epoch 798
Validation auc = 0.760442
Epoch 799
Validation auc = 0.755576
Epoch 800
Validation auc = 0.751367
Epoch 801
Loss = 4.0635e-03, PNorm = 94.7214, GNorm = 0.0402, lr_0 = 9.6045e-04
Loss = 2.3786e-02, PNorm = 94.7316, GNorm = 0.7895, lr_0 = 9.6043e-04
Validation auc = 0.742510
Epoch 802
Validation auc = 0.739285
Epoch 803
Validation auc = 0.749399
Epoch 804
Validation auc = 0.759075
Epoch 805
Validation auc = 0.768314
Epoch 806
Loss = 4.7510e-02, PNorm = 94.9033, GNorm = 0.2494, lr_0 = 9.6019e-04
Loss = 1.3221e-01, PNorm = 94.9128, GNorm = 4.2205, lr_0 = 9.6018e-04
Validation auc = 0.768533
Epoch 807
Validation auc = 0.766674
Epoch 808
Validation auc = 0.763011
Epoch 809
Validation auc = 0.758966
Epoch 810
Validation auc = 0.752460
Epoch 811
Loss = 1.4455e-02, PNorm = 95.0590, GNorm = 0.1851, lr_0 = 9.5996e-04
Validation auc = 0.745572
Epoch 812
Validation auc = 0.741854
Epoch 813
Validation auc = 0.743604
Epoch 814
Validation auc = 0.746119
Epoch 815
Validation auc = 0.750219
Epoch 816
Loss = 3.6038e-03, PNorm = 95.2200, GNorm = 0.0812, lr_0 = 9.5970e-04
Validation auc = 0.751039
Epoch 817
Validation auc = 0.753608
Epoch 818
Validation auc = 0.759184
Epoch 819
Validation auc = 0.762136
Epoch 820
Loss = 2.4377e-03, PNorm = 95.3048, GNorm = 0.0220, lr_0 = 9.5948e-04
Loss = 2.5243e-03, PNorm = 95.3095, GNorm = 0.0499, lr_0 = 9.5946e-04
Validation auc = 0.761754
Epoch 821
Validation auc = 0.761808
Epoch 822
Validation auc = 0.762027
Epoch 823
Validation auc = 0.761535
Epoch 824
Validation auc = 0.758200
Epoch 825
Loss = 2.4271e-03, PNorm = 95.3499, GNorm = 0.0337, lr_0 = 9.5924e-04
Validation auc = 0.753116
Epoch 826
Validation auc = 0.749071
Epoch 827
Validation auc = 0.746665
Epoch 828
Validation auc = 0.746392
Epoch 829
Validation auc = 0.750219
Epoch 830
Loss = 8.6265e-04, PNorm = 95.3857, GNorm = 0.0140, lr_0 = 9.5899e-04
Validation auc = 0.752296
Epoch 831
Validation auc = 0.754702
Epoch 832
Validation auc = 0.756232
Epoch 833
Validation auc = 0.756998
Epoch 834
Loss = 5.4251e-03, PNorm = 95.4173, GNorm = 1.1187, lr_0 = 9.5877e-04
Loss = 5.5232e-01, PNorm = 95.4144, GNorm = 6.6361, lr_0 = 9.5875e-04
Validation auc = 0.760496
Epoch 835
Validation auc = 0.759567
Epoch 836
Validation auc = 0.762027
Epoch 837
Validation auc = 0.766237
Epoch 838
Validation auc = 0.767658
Epoch 839
Loss = 3.1554e-02, PNorm = 95.4819, GNorm = 0.0394, lr_0 = 9.5851e-04
Loss = 4.6920e-04, PNorm = 95.4890, GNorm = 0.0125, lr_0 = 9.5849e-04
Validation auc = 0.767275
Epoch 840
Validation auc = 0.763722
Epoch 841
Validation auc = 0.759184
Epoch 842
Validation auc = 0.756068
Epoch 843
Validation auc = 0.754756
Epoch 844
Loss = 3.2080e-02, PNorm = 95.5631, GNorm = 1.3073, lr_0 = 9.5827e-04
Validation auc = 0.750656
Epoch 845
Validation auc = 0.748087
Epoch 846
Validation auc = 0.745517
Epoch 847
Validation auc = 0.743986
Epoch 848
Validation auc = 0.743932
Epoch 849
Loss = 2.6095e-03, PNorm = 95.6581, GNorm = 0.0380, lr_0 = 9.5802e-04
Validation auc = 0.744424
Epoch 850
Validation auc = 0.744861
Epoch 851
Validation auc = 0.745900
Epoch 852
Validation auc = 0.746064
Epoch 853
Loss = 2.3050e-04, PNorm = 95.7361, GNorm = 0.0195, lr_0 = 9.5780e-04
Loss = 6.5365e-06, PNorm = 95.7413, GNorm = 0.0003, lr_0 = 9.5778e-04
Validation auc = 0.746501
Epoch 854
Validation auc = 0.744642
Epoch 855
Validation auc = 0.738848
Epoch 856
Validation auc = 0.732561
Epoch 857
Validation auc = 0.733381
Epoch 858
Loss = 2.2825e-03, PNorm = 95.7788, GNorm = 0.0290, lr_0 = 9.5754e-04
Validation auc = 0.738902
Epoch 859
Validation auc = 0.743221
Epoch 860
Validation auc = 0.747048
Epoch 861
Validation auc = 0.749508
Epoch 862
Validation auc = 0.751367
Epoch 863
Loss = 7.8661e-04, PNorm = 95.8453, GNorm = 0.0138, lr_0 = 9.5730e-04
Validation auc = 0.752187
Epoch 864
Validation auc = 0.753608
Epoch 865
Validation auc = 0.753007
Epoch 866
Validation auc = 0.750984
Epoch 867
Loss = 3.8992e-04, PNorm = 95.8810, GNorm = 0.0104, lr_0 = 9.5708e-04
Loss = 2.0573e-04, PNorm = 95.8831, GNorm = 0.0053, lr_0 = 9.5707e-04
Validation auc = 0.749508
Epoch 868
Validation auc = 0.748633
Epoch 869
Validation auc = 0.748196
Epoch 870
Validation auc = 0.747923
Epoch 871
Validation auc = 0.747813
Epoch 872
Loss = 3.9124e-04, PNorm = 95.9076, GNorm = 0.0122, lr_0 = 9.5683e-04
Loss = 8.3410e-04, PNorm = 95.9091, GNorm = 0.0324, lr_0 = 9.5681e-04
Validation auc = 0.747540
Epoch 873
Validation auc = 0.747540
Epoch 874
Validation auc = 0.748415
Epoch 875
Validation auc = 0.748961
Epoch 876
Validation auc = 0.749399
Epoch 877
Loss = 5.1639e-04, PNorm = 95.9298, GNorm = 0.0133, lr_0 = 9.5659e-04
Validation auc = 0.749344
Epoch 878
Validation auc = 0.749125
Epoch 879
Validation auc = 0.748579
Epoch 880
Validation auc = 0.748196
Epoch 881
Validation auc = 0.748688
Epoch 882
Loss = 3.7410e-03, PNorm = 95.9530, GNorm = 0.2130, lr_0 = 9.5634e-04
Validation auc = 0.749071
Epoch 883
Validation auc = 0.748032
Epoch 884
Validation auc = 0.746447
Epoch 885
Validation auc = 0.745736
Epoch 886
Loss = 6.8567e-04, PNorm = 95.9793, GNorm = 0.0302, lr_0 = 9.5612e-04
Loss = 5.4928e-04, PNorm = 95.9813, GNorm = 0.0155, lr_0 = 9.5610e-04
Validation auc = 0.744697
Epoch 887
Validation auc = 0.745189
Epoch 888
Validation auc = 0.746119
Epoch 889
Validation auc = 0.746829
Epoch 890
Validation auc = 0.747103
Epoch 891
Loss = 1.2133e-04, PNorm = 96.0045, GNorm = 0.0021, lr_0 = 9.5586e-04
Validation auc = 0.747321
Epoch 892
Validation auc = 0.747595
Epoch 893
Validation auc = 0.747759
Epoch 894
Validation auc = 0.748196
Epoch 895
Validation auc = 0.748360
Epoch 896
Loss = 1.7513e-04, PNorm = 96.0174, GNorm = 0.0169, lr_0 = 9.5563e-04
Validation auc = 0.745080
Epoch 897
Validation auc = 0.741144
Epoch 898
Validation auc = 0.738356
Epoch 899
Validation auc = 0.737918
Epoch 900
Loss = 3.1692e-03, PNorm = 96.0257, GNorm = 0.2525, lr_0 = 9.5541e-04
Loss = 9.9902e-04, PNorm = 96.0281, GNorm = 0.0649, lr_0 = 9.5539e-04
Validation auc = 0.738902
Epoch 901
Validation auc = 0.739504
Epoch 902
Validation auc = 0.740652
Epoch 903
Validation auc = 0.741362
Epoch 904
Validation auc = 0.742346
Epoch 905
Loss = 1.1932e-04, PNorm = 96.0613, GNorm = 0.0013, lr_0 = 9.5515e-04
Loss = 2.3047e-06, PNorm = 96.0632, GNorm = 0.0001, lr_0 = 9.5513e-04
Validation auc = 0.742510
Epoch 906
Validation auc = 0.743494
Epoch 907
Validation auc = 0.743713
Epoch 908
Validation auc = 0.743986
Epoch 909
Validation auc = 0.743986
Epoch 910
Loss = 4.2920e-05, PNorm = 96.0800, GNorm = 0.0011, lr_0 = 9.5491e-04
Validation auc = 0.745025
Epoch 911
Validation auc = 0.745572
Epoch 912
Validation auc = 0.746009
Epoch 913
Validation auc = 0.746884
Epoch 914
Validation auc = 0.747103
Epoch 915
Loss = 4.3353e-04, PNorm = 96.0762, GNorm = 0.0095, lr_0 = 9.5466e-04
Validation auc = 0.747267
Epoch 916
Validation auc = 0.747540
Epoch 917
Validation auc = 0.747431
Epoch 918
Validation auc = 0.747431
Epoch 919
Loss = 2.0471e-04, PNorm = 96.0951, GNorm = 0.0014, lr_0 = 9.5444e-04
Loss = 2.7694e-05, PNorm = 96.0966, GNorm = 0.0013, lr_0 = 9.5442e-04
Validation auc = 0.748032
Epoch 920
Validation auc = 0.748251
Epoch 921
Validation auc = 0.748633
Epoch 922
Validation auc = 0.748688
Epoch 923
Validation auc = 0.748524
Epoch 924
Loss = 5.7454e-05, PNorm = 96.1120, GNorm = 0.0019, lr_0 = 9.5419e-04
Validation auc = 0.748688
Epoch 925
Validation auc = 0.742838
Epoch 926
Validation auc = 0.758966
Epoch 927
Validation auc = 0.798163
Epoch 928
Validation auc = 0.813962
Epoch 929
Loss = 1.0953e-04, PNorm = 96.2444, GNorm = 0.0041, lr_0 = 9.5395e-04
Validation auc = 0.791658
Epoch 930
Validation auc = 0.795922
Epoch 931
Validation auc = 0.795375
Epoch 932
Validation auc = 0.796632
Epoch 933
Loss = 1.5310e-01, PNorm = 96.6428, GNorm = 26.8767, lr_0 = 9.5371e-04
Validation auc = 0.773453
Epoch 934
Validation auc = 0.774054
Epoch 935
Validation auc = 0.767166
Epoch 936
Validation auc = 0.756724
Epoch 937
Validation auc = 0.763558
Epoch 938
Loss = 3.7834e-02, PNorm = 97.1406, GNorm = 0.9090, lr_0 = 9.5348e-04
Loss = 2.1117e-01, PNorm = 97.1726, GNorm = 9.3824, lr_0 = 9.5346e-04
Validation auc = 0.769954
Epoch 939
Validation auc = 0.759020
Epoch 940
Validation auc = 0.763722
Epoch 941
Validation auc = 0.770829
Epoch 942
Validation auc = 0.763011
Epoch 943
Loss = 2.8724e-02, PNorm = 97.5937, GNorm = 0.4109, lr_0 = 9.5324e-04
Validation auc = 0.762574
Epoch 944
Validation auc = 0.770555
Epoch 945
Validation auc = 0.773125
Epoch 946
Validation auc = 0.764925
Epoch 947
Validation auc = 0.752624
Epoch 948
Loss = 1.4182e-01, PNorm = 97.9006, GNorm = 1.5003, lr_0 = 9.5299e-04
Validation auc = 0.763066
Epoch 949
Validation auc = 0.782637
Epoch 950
Validation auc = 0.788924
Epoch 951
Validation auc = 0.790728
Epoch 952
Loss = 1.7031e-01, PNorm = 98.1141, GNorm = 0.5193, lr_0 = 9.5277e-04
Loss = 6.6133e-03, PNorm = 98.1265, GNorm = 0.1165, lr_0 = 9.5275e-04
Validation auc = 0.773180
Epoch 953
Validation auc = 0.761590
Epoch 954
Validation auc = 0.758856
Epoch 955
Validation auc = 0.758474
Epoch 956
Validation auc = 0.762246
Epoch 957
Loss = 2.4332e-02, PNorm = 98.3257, GNorm = 0.8559, lr_0 = 9.5251e-04
Loss = 1.7257e-02, PNorm = 98.3394, GNorm = 0.3218, lr_0 = 9.5250e-04
Validation auc = 0.767275
Epoch 958
Validation auc = 0.771813
Epoch 959
Validation auc = 0.769407
Epoch 960
Validation auc = 0.765854
Epoch 961
Validation auc = 0.756396
Epoch 962
Loss = 6.0141e-03, PNorm = 98.4650, GNorm = 0.2610, lr_0 = 9.5228e-04
Validation auc = 0.742401
Epoch 963
Validation auc = 0.735130
Epoch 964
Validation auc = 0.744642
Epoch 965
Validation auc = 0.751531
Epoch 966
Loss = 2.7787e-03, PNorm = 98.5653, GNorm = 0.0071, lr_0 = 9.5204e-04
Validation auc = 0.754811
Epoch 967
Validation auc = 0.754538
Epoch 968
Validation auc = 0.751695
Epoch 969
Validation auc = 0.748469
Epoch 970
Validation auc = 0.751421
Epoch 971
Loss = 6.2818e-03, PNorm = 98.6402, GNorm = 0.1580, lr_0 = 9.5180e-04
Loss = 1.8424e-03, PNorm = 98.6453, GNorm = 0.0638, lr_0 = 9.5179e-04
Validation auc = 0.753007
Epoch 972
Validation auc = 0.759786
Epoch 973
Validation auc = 0.765745
Epoch 974
Validation auc = 0.767931
Epoch 975
Validation auc = 0.768533
Epoch 976
Loss = 4.5387e-04, PNorm = 98.7205, GNorm = 0.0094, lr_0 = 9.5157e-04
Validation auc = 0.769243
Epoch 977
Validation auc = 0.769079
Epoch 978
Validation auc = 0.749344
Epoch 979
Validation auc = 0.737700
Epoch 980
Validation auc = 0.729718
Epoch 981
Loss = 6.7180e-03, PNorm = 98.7666, GNorm = 0.7727, lr_0 = 9.5132e-04
Validation auc = 0.729499
Epoch 982
Validation auc = 0.729390
Epoch 983
Validation auc = 0.728625
Epoch 984
Validation auc = 0.728133
Epoch 985
Loss = 3.3659e-03, PNorm = 98.8186, GNorm = 0.0383, lr_0 = 9.5110e-04
Loss = 7.4651e-05, PNorm = 98.8216, GNorm = 0.0028, lr_0 = 9.5108e-04
Validation auc = 0.728078
Epoch 986
Validation auc = 0.727476
Epoch 987
Validation auc = 0.725946
Epoch 988
Validation auc = 0.725180
Epoch 989
Validation auc = 0.725563
Epoch 990
Loss = 8.5847e-03, PNorm = 98.8507, GNorm = 0.7021, lr_0 = 9.5084e-04
Loss = 6.7567e-05, PNorm = 98.8529, GNorm = 0.0024, lr_0 = 9.5083e-04
Validation auc = 0.728297
Epoch 991
Validation auc = 0.730265
Epoch 992
Validation auc = 0.731249
Epoch 993
Validation auc = 0.732943
Epoch 994
Validation auc = 0.734419
Epoch 995
Loss = 5.3610e-02, PNorm = 98.8795, GNorm = 2.8148, lr_0 = 9.5061e-04
Validation auc = 0.731413
Epoch 996
Validation auc = 0.739504
Epoch 997
Validation auc = 0.723103
Epoch 998
Validation auc = 0.698557
Epoch 999
Loss = 4.1234e-02, PNorm = 98.9949, GNorm = 0.0236, lr_0 = 9.5037e-04
Validation auc = 0.679751
Epoch 1000
Validation auc = 0.664498
Epoch 1001
Validation auc = 0.672917
Epoch 1002
Validation auc = 0.688935
Epoch 1003
Validation auc = 0.699267
Epoch 1004
Loss = 4.2371e-02, PNorm = 99.2827, GNorm = 0.4096, lr_0 = 9.5014e-04
Loss = 2.5452e-03, PNorm = 99.3002, GNorm = 0.0655, lr_0 = 9.5012e-04
Validation auc = 0.702384
Epoch 1005
Validation auc = 0.703258
Epoch 1006
Validation auc = 0.705554
Epoch 1007
Validation auc = 0.711732
Epoch 1008
Validation auc = 0.720479
Epoch 1009
Loss = 2.7271e-02, PNorm = 99.4793, GNorm = 1.0077, lr_0 = 9.4990e-04
Validation auc = 0.734638
Epoch 1010
Validation auc = 0.742565
Epoch 1011
Validation auc = 0.744970
Epoch 1012
Validation auc = 0.739449
Epoch 1013
Validation auc = 0.735021
Epoch 1014
Loss = 2.5162e-02, PNorm = 99.6137, GNorm = 0.7661, lr_0 = 9.4965e-04
Validation auc = 0.735895
Epoch 1015
Validation auc = 0.735239
Epoch 1016
Validation auc = 0.734419
Epoch 1017
Validation auc = 0.731303
Epoch 1018
Loss = 3.8113e-02, PNorm = 99.6704, GNorm = 2.0050, lr_0 = 9.4943e-04
Loss = 6.6324e-03, PNorm = 99.6754, GNorm = 0.1608, lr_0 = 9.4941e-04
Validation auc = 0.726383
Epoch 1019
Validation auc = 0.728898
Epoch 1020
Validation auc = 0.734583
Epoch 1021
Validation auc = 0.751367
Epoch 1022
Validation auc = 0.772250
Epoch 1023
Loss = 8.6543e-04, PNorm = 99.7697, GNorm = 0.0200, lr_0 = 9.4918e-04
Loss = 4.5072e-04, PNorm = 99.7770, GNorm = 0.0155, lr_0 = 9.4916e-04
Validation auc = 0.784551
Epoch 1024
Validation auc = 0.792478
Epoch 1025
Validation auc = 0.791986
Epoch 1026
Validation auc = 0.787885
Epoch 1027
Validation auc = 0.779958
Epoch 1028
Loss = 6.1474e-04, PNorm = 99.8563, GNorm = 0.0116, lr_0 = 9.4894e-04
Validation auc = 0.771375
Epoch 1029
Validation auc = 0.768205
Epoch 1030
Validation auc = 0.768533
Epoch 1031
Validation auc = 0.758856
Epoch 1032
Validation auc = 0.755740
Epoch 1033
Loss = 1.2946e-03, PNorm = 99.9413, GNorm = 0.0290, lr_0 = 9.4869e-04
Validation auc = 0.754702
Epoch 1034
Validation auc = 0.755522
Epoch 1035
Validation auc = 0.767603
Epoch 1036
Validation auc = 0.771922
Epoch 1037
Loss = 2.8414e-04, PNorm = 100.0268, GNorm = 0.0044, lr_0 = 9.4847e-04
Loss = 3.5740e-05, PNorm = 100.0326, GNorm = 0.0014, lr_0 = 9.4845e-04
Validation auc = 0.774273
Epoch 1038
Validation auc = 0.773125
Epoch 1039
Validation auc = 0.770719
Epoch 1040
Validation auc = 0.765471
Epoch 1041
Validation auc = 0.763394
Epoch 1042
Loss = 5.7045e-03, PNorm = 100.0529, GNorm = 0.1058, lr_0 = 9.4823e-04
Validation auc = 0.762027
Epoch 1043
Validation auc = 0.762902
Epoch 1044
Validation auc = 0.763394
Epoch 1045
Validation auc = 0.763941
Epoch 1046
Validation auc = 0.760496
Epoch 1047
Loss = 4.8125e-03, PNorm = 100.0983, GNorm = 0.0665, lr_0 = 9.4798e-04
Validation auc = 0.757490
Epoch 1048
Validation auc = 0.755303
Epoch 1049
Validation auc = 0.754647
Epoch 1050
Validation auc = 0.755194
Epoch 1051
Loss = 1.8861e-03, PNorm = 100.1434, GNorm = 0.0362, lr_0 = 9.4776e-04
Loss = 5.1353e-04, PNorm = 100.1467, GNorm = 0.0143, lr_0 = 9.4775e-04
Validation auc = 0.756560
Epoch 1052
Validation auc = 0.755850
Epoch 1053
Validation auc = 0.753553
Epoch 1054
Validation auc = 0.751257
Epoch 1055
Validation auc = 0.750383
Epoch 1056
Loss = 7.3893e-03, PNorm = 100.2021, GNorm = 0.3563, lr_0 = 9.4751e-04
Loss = 1.2589e-01, PNorm = 100.2081, GNorm = 7.4457, lr_0 = 9.4749e-04
Validation auc = 0.753116
Epoch 1057
Validation auc = 0.760332
Epoch 1058
Validation auc = 0.762082
Epoch 1059
Validation auc = 0.760332
Epoch 1060
Validation auc = 0.756724
Epoch 1061
Loss = 1.1029e-02, PNorm = 100.3404, GNorm = 0.5380, lr_0 = 9.4728e-04
Validation auc = 0.751093
Epoch 1062
Validation auc = 0.754428
Epoch 1063
Validation auc = 0.758036
Epoch 1064
Validation auc = 0.761262
Epoch 1065
Validation auc = 0.765745
Epoch 1066
Loss = 3.5086e-03, PNorm = 100.4634, GNorm = 0.2702, lr_0 = 9.4702e-04
Validation auc = 0.768205
Epoch 1067
Validation auc = 0.766783
Epoch 1068
Validation auc = 0.765635
Epoch 1069
Validation auc = 0.765034
Epoch 1070
Loss = 4.7180e-04, PNorm = 100.5228, GNorm = 0.0176, lr_0 = 9.4681e-04
Loss = 2.1859e-04, PNorm = 100.5272, GNorm = 0.0059, lr_0 = 9.4679e-04
Validation auc = 0.762574
Epoch 1071
Validation auc = 0.763831
Epoch 1072
Validation auc = 0.765745
Epoch 1073
Validation auc = 0.766291
Epoch 1074
Validation auc = 0.766455
Epoch 1075
Loss = 8.8865e-05, PNorm = 100.5696, GNorm = 0.0021, lr_0 = 9.4657e-04
Validation auc = 0.774710
Epoch 1076
Validation auc = 0.784059
Epoch 1077
Validation auc = 0.781817
Epoch 1078
Validation auc = 0.777826
Epoch 1079
Validation auc = 0.774382
Epoch 1080
Loss = 1.9848e-03, PNorm = 100.6191, GNorm = 0.1193, lr_0 = 9.4632e-04
Validation auc = 0.773344
Epoch 1081
Validation auc = 0.777936
Epoch 1082
Validation auc = 0.778428
Epoch 1083
Validation auc = 0.779302
Epoch 1084
Loss = 1.4369e-02, PNorm = 100.6791, GNorm = 0.0101, lr_0 = 9.4610e-04
Loss = 2.2214e-03, PNorm = 100.6828, GNorm = 0.2016, lr_0 = 9.4608e-04
Validation auc = 0.779193
Epoch 1085
Validation auc = 0.779357
Epoch 1086
Validation auc = 0.778537
Epoch 1087
Validation auc = 0.779958
Epoch 1088
Validation auc = 0.781325
Epoch 1089
Loss = 5.1551e-02, PNorm = 100.7413, GNorm = 0.0354, lr_0 = 9.4585e-04
Loss = 1.6477e-03, PNorm = 100.7443, GNorm = 0.0386, lr_0 = 9.4583e-04
Validation auc = 0.778756
Epoch 1090
Validation auc = 0.775858
Epoch 1091
Validation auc = 0.774273
Epoch 1092
Validation auc = 0.775913
Epoch 1093
Validation auc = 0.778592
Epoch 1094
Loss = 2.3896e-02, PNorm = 100.7718, GNorm = 0.7515, lr_0 = 9.4561e-04
Validation auc = 0.779576
Epoch 1095
Validation auc = 0.780068
Epoch 1096
Validation auc = 0.781653
Epoch 1097
Validation auc = 0.782036
Epoch 1098
Validation auc = 0.782473
Epoch 1099
Loss = 8.6833e-04, PNorm = 100.8140, GNorm = 0.0182, lr_0 = 9.4536e-04
Validation auc = 0.782637
Epoch 1100
Validation auc = 0.783239
Epoch 1101
Validation auc = 0.783949
Epoch 1102
Validation auc = 0.783676
Epoch 1103
Loss = 5.3553e-04, PNorm = 100.8405, GNorm = 0.0079, lr_0 = 9.4515e-04
Loss = 9.9805e-05, PNorm = 100.8426, GNorm = 0.0029, lr_0 = 9.4513e-04
Validation auc = 0.783184
Epoch 1104
Validation auc = 0.782637
Epoch 1105
Validation auc = 0.781489
Epoch 1106
Validation auc = 0.778646
Epoch 1107
Validation auc = 0.776897
Epoch 1108
Loss = 2.6513e-03, PNorm = 100.8754, GNorm = 0.0534, lr_0 = 9.4489e-04
Validation auc = 0.776350
Epoch 1109
Validation auc = 0.776842
Epoch 1110
Validation auc = 0.776569
Epoch 1111
Validation auc = 0.776460
Epoch 1112
Validation auc = 0.775858
Epoch 1113
Loss = 1.2795e-04, PNorm = 100.9002, GNorm = 0.0028, lr_0 = 9.4466e-04
Validation auc = 0.775804
Epoch 1114
Validation auc = 0.775804
Epoch 1115
Validation auc = 0.775476
Epoch 1116
Validation auc = 0.775202
Epoch 1117
Loss = 5.2206e-04, PNorm = 100.9131, GNorm = 0.0290, lr_0 = 9.4444e-04
Loss = 1.5689e-04, PNorm = 100.9140, GNorm = 0.0091, lr_0 = 9.4443e-04
Validation auc = 0.774656
Epoch 1118
Validation auc = 0.773890
Epoch 1119
Validation auc = 0.773289
Epoch 1120
Validation auc = 0.773289
Epoch 1121
Validation auc = 0.773180
Epoch 1122
Loss = 1.0570e-04, PNorm = 100.9227, GNorm = 0.0014, lr_0 = 9.4419e-04
Loss = 8.8689e-05, PNorm = 100.9232, GNorm = 0.0032, lr_0 = 9.4417e-04
Validation auc = 0.773016
Epoch 1123
Validation auc = 0.767822
Epoch 1124
Validation auc = 0.757052
Epoch 1125
Validation auc = 0.766455
Epoch 1126
Validation auc = 0.764870
Epoch 1127
Loss = 1.8828e-04, PNorm = 100.9403, GNorm = 0.0050, lr_0 = 9.4396e-04
Validation auc = 0.764105
Epoch 1128
Validation auc = 0.763230
Epoch 1129
Validation auc = 0.764214
Epoch 1130
Validation auc = 0.763011
Epoch 1131
Validation auc = 0.760934
Epoch 1132
Loss = 3.7114e-03, PNorm = 101.0053, GNorm = 0.1353, lr_0 = 9.4371e-04
Validation auc = 0.759567
Epoch 1133
Validation auc = 0.758474
Epoch 1134
Validation auc = 0.756998
Epoch 1135
Validation auc = 0.755631
Epoch 1136
Loss = 6.9762e-03, PNorm = 101.0485, GNorm = 0.0852, lr_0 = 9.4349e-04
Loss = 9.2844e-05, PNorm = 101.0511, GNorm = 0.0034, lr_0 = 9.4347e-04
Validation auc = 0.752843
Epoch 1137
Validation auc = 0.751312
Epoch 1138
Validation auc = 0.749235
Epoch 1139
Validation auc = 0.748633
Epoch 1140
Validation auc = 0.746337
Epoch 1141
Loss = 1.4208e-02, PNorm = 101.0838, GNorm = 1.5584, lr_0 = 9.4324e-04
Validation auc = 0.743713
Epoch 1142
Validation auc = 0.743057
Epoch 1143
Validation auc = 0.744806
Epoch 1144
Validation auc = 0.748633
Epoch 1145
Validation auc = 0.753499
Epoch 1146
Loss = 2.7987e-04, PNorm = 101.1372, GNorm = 0.0060, lr_0 = 9.4300e-04
Validation auc = 0.756724
Epoch 1147
Validation auc = 0.758966
Epoch 1148
Validation auc = 0.759458
Epoch 1149
Validation auc = 0.759895
Epoch 1150
Loss = 6.2129e-04, PNorm = 101.1654, GNorm = 0.0047, lr_0 = 9.4279e-04
Loss = 1.0114e-04, PNorm = 101.1667, GNorm = 0.0029, lr_0 = 9.4277e-04
Validation auc = 0.760278
Epoch 1151
Validation auc = 0.761371
Epoch 1152
Validation auc = 0.757872
Epoch 1153
Validation auc = 0.754373
Epoch 1154
Validation auc = 0.750875
Epoch 1155
Loss = 1.4520e-03, PNorm = 101.1841, GNorm = 0.0172, lr_0 = 9.4253e-04
Loss = 1.8378e-05, PNorm = 101.1853, GNorm = 0.0007, lr_0 = 9.4252e-04
Validation auc = 0.747431
Epoch 1156
Validation auc = 0.745681
Epoch 1157
Validation auc = 0.744806
Epoch 1158
Validation auc = 0.727039
Epoch 1159
Validation auc = 0.702548
Epoch 1160
Loss = 1.8638e-02, PNorm = 101.2397, GNorm = 0.8876, lr_0 = 9.4230e-04
Validation auc = 0.697026
Epoch 1161
Validation auc = 0.690520
Epoch 1162
Validation auc = 0.686202
Epoch 1163
Validation auc = 0.685874
Epoch 1164
Validation auc = 0.686475
Epoch 1165
Loss = 2.1215e-02, PNorm = 101.3574, GNorm = 1.0379, lr_0 = 9.4205e-04
Validation auc = 0.710584
Epoch 1166
Validation auc = 0.725126
Epoch 1167
Validation auc = 0.735185
Epoch 1168
Validation auc = 0.746228
Epoch 1169
Loss = 4.8022e-03, PNorm = 101.5194, GNorm = 0.0248, lr_0 = 9.4183e-04
Loss = 1.1700e-02, PNorm = 101.5299, GNorm = 0.1952, lr_0 = 9.4182e-04
Validation auc = 0.751203
Epoch 1170
Validation auc = 0.741636
Epoch 1171
Validation auc = 0.735895
Epoch 1172
Validation auc = 0.719714
Epoch 1173
Validation auc = 0.729718
Epoch 1174
Loss = 3.7638e-03, PNorm = 101.6823, GNorm = 0.0784, lr_0 = 9.4158e-04
Validation auc = 0.742182
Epoch 1175
Validation auc = 0.750273
Epoch 1176
Validation auc = 0.756834
Epoch 1177
Validation auc = 0.759895
Epoch 1178
Validation auc = 0.762136
Epoch 1179
Loss = 3.7415e-02, PNorm = 101.8524, GNorm = 1.4411, lr_0 = 9.4135e-04
Validation auc = 0.757708
Epoch 1180
Validation auc = 0.750656
Epoch 1181
Validation auc = 0.751968
Epoch 1182
Validation auc = 0.743549
Epoch 1183
Loss = 4.0387e-03, PNorm = 102.0308, GNorm = 0.1834, lr_0 = 9.4112e-04
Validation auc = 0.736551
Epoch 1184
Validation auc = 0.728843
Epoch 1185
Validation auc = 0.728898
Epoch 1186
Validation auc = 0.730538
Epoch 1187
Validation auc = 0.734037
Epoch 1188
Loss = 3.3829e-02, PNorm = 102.1863, GNorm = 0.4471, lr_0 = 9.4088e-04
Loss = 9.9124e-02, PNorm = 102.1976, GNorm = 4.2808, lr_0 = 9.4087e-04
Validation auc = 0.748305
Epoch 1189
Validation auc = 0.772742
Epoch 1190
Validation auc = 0.777389
Epoch 1191
Validation auc = 0.762847
Epoch 1192
Validation auc = 0.750711
Epoch 1193
Loss = 8.1982e-03, PNorm = 102.3856, GNorm = 0.1361, lr_0 = 9.4065e-04
Validation auc = 0.739394
Epoch 1194
Validation auc = 0.729609
Epoch 1195
Validation auc = 0.723978
Epoch 1196
Validation auc = 0.718948
Epoch 1197
Validation auc = 0.713700
Epoch 1198
Loss = 7.6847e-05, PNorm = 102.5509, GNorm = 0.0019, lr_0 = 9.4040e-04
Validation auc = 0.703368
Epoch 1199
Validation auc = 0.737098
Epoch 1200
Validation auc = 0.757216
Epoch 1201
Validation auc = 0.766346
Epoch 1202
Loss = 8.3818e-02, PNorm = 102.6621, GNorm = 2.1009, lr_0 = 9.4018e-04
Loss = 2.4225e-03, PNorm = 102.6719, GNorm = 0.0809, lr_0 = 9.4016e-04
Validation auc = 0.761316
Epoch 1203
Validation auc = 0.756943
Epoch 1204
Validation auc = 0.755139
Epoch 1205
Validation auc = 0.752624
Epoch 1206
Validation auc = 0.750711
Epoch 1207
Loss = 1.6738e-03, PNorm = 102.8237, GNorm = 0.0292, lr_0 = 9.3993e-04
Loss = 9.6862e-03, PNorm = 102.8320, GNorm = 0.4349, lr_0 = 9.3991e-04
Validation auc = 0.748141
Epoch 1208
Validation auc = 0.748032
Epoch 1209
Validation auc = 0.727695
Epoch 1210
Validation auc = 0.719714
Epoch 1211
Validation auc = 0.715996
Epoch 1212
Loss = 1.5039e-03, PNorm = 102.9094, GNorm = 0.0262, lr_0 = 9.3970e-04
Validation auc = 0.714575
Epoch 1213
Validation auc = 0.714411
Epoch 1214
Validation auc = 0.714739
Epoch 1215
Validation auc = 0.715012
Epoch 1216
Loss = 5.2698e-03, PNorm = 102.9775, GNorm = 0.0074, lr_0 = 9.3946e-04
Validation auc = 0.714137
Epoch 1217
Validation auc = 0.714848
Epoch 1218
Validation auc = 0.707413
Epoch 1219
Validation auc = 0.721955
Epoch 1220
Validation auc = 0.730921
Epoch 1221
Loss = 8.7697e-04, PNorm = 103.0625, GNorm = 0.0151, lr_0 = 9.3923e-04
Loss = 2.7440e-04, PNorm = 103.0706, GNorm = 0.0066, lr_0 = 9.3922e-04
Validation auc = 0.737481
Epoch 1222
Validation auc = 0.737317
Epoch 1223
Validation auc = 0.737098
Epoch 1224
Validation auc = 0.738465
Epoch 1225
Validation auc = 0.741581
Epoch 1226
Loss = 1.1654e-02, PNorm = 103.1847, GNorm = 0.2424, lr_0 = 9.3900e-04
Validation auc = 0.747212
Epoch 1227
Validation auc = 0.749125
Epoch 1228
Validation auc = 0.747376
Epoch 1229
Validation auc = 0.744041
Epoch 1230
Validation auc = 0.739613
Epoch 1231
Loss = 3.1582e-03, PNorm = 103.3144, GNorm = 0.0595, lr_0 = 9.3875e-04
Validation auc = 0.734474
Epoch 1232
Validation auc = 0.728406
Epoch 1233
Validation auc = 0.724743
Epoch 1234
Validation auc = 0.727969
Epoch 1235
Loss = 7.6029e-03, PNorm = 103.4009, GNorm = 1.0187, lr_0 = 9.3853e-04
Loss = 7.9319e-05, PNorm = 103.4072, GNorm = 0.0022, lr_0 = 9.3852e-04
Validation auc = 0.729937
Epoch 1236
Validation auc = 0.730593
Epoch 1237
Validation auc = 0.731358
Epoch 1238
Validation auc = 0.731577
Epoch 1239
Validation auc = 0.731522
Epoch 1240
Loss = 1.7089e-03, PNorm = 103.4696, GNorm = 0.0539, lr_0 = 9.3828e-04
Loss = 3.7235e-03, PNorm = 103.4730, GNorm = 0.3131, lr_0 = 9.3827e-04
Validation auc = 0.729882
Epoch 1241
Validation auc = 0.727640
Epoch 1242
Validation auc = 0.726274
Epoch 1243
Validation auc = 0.726930
Epoch 1244
Validation auc = 0.722283
Epoch 1245
Loss = 1.7119e-03, PNorm = 103.5184, GNorm = 0.1077, lr_0 = 9.3805e-04
Validation auc = 0.720807
Epoch 1246
Validation auc = 0.733709
Epoch 1247
Validation auc = 0.740597
Epoch 1248
Validation auc = 0.744916
Epoch 1249
Loss = 2.3119e-03, PNorm = 103.5807, GNorm = 0.0453, lr_0 = 9.3782e-04
Validation auc = 0.744260
Epoch 1250
Validation auc = 0.744096
Epoch 1251
Validation auc = 0.741089
Epoch 1252
Validation auc = 0.741581
Epoch 1253
Validation auc = 0.740378
Epoch 1254
Loss = 1.5786e-03, PNorm = 103.6297, GNorm = 0.0511, lr_0 = 9.3758e-04
Loss = 2.3660e-03, PNorm = 103.6329, GNorm = 0.0885, lr_0 = 9.3757e-04
Validation auc = 0.739066
Epoch 1255
Validation auc = 0.737262
Epoch 1256
Validation auc = 0.736880
Epoch 1257
Validation auc = 0.736825
Epoch 1258
Validation auc = 0.738137
Epoch 1259
Loss = 1.1499e-03, PNorm = 103.6676, GNorm = 0.0299, lr_0 = 9.3735e-04
Validation auc = 0.740105
Epoch 1260
Validation auc = 0.740597
Epoch 1261
Validation auc = 0.741253
Epoch 1262
Validation auc = 0.742565
Epoch 1263
Validation auc = 0.742346
Epoch 1264
Loss = 1.3718e-04, PNorm = 103.6915, GNorm = 0.0032, lr_0 = 9.3710e-04
Validation auc = 0.741472
Epoch 1265
Validation auc = 0.740870
Epoch 1266
Validation auc = 0.741034
Epoch 1267
Validation auc = 0.740980
Epoch 1268
Loss = 2.6643e-04, PNorm = 103.7061, GNorm = 0.0087, lr_0 = 9.3689e-04
Loss = 1.2077e-03, PNorm = 103.7071, GNorm = 0.0353, lr_0 = 9.3687e-04
Validation auc = 0.740542
Epoch 1269
Validation auc = 0.740597
Epoch 1270
Validation auc = 0.740433
Epoch 1271
Validation auc = 0.739886
Epoch 1272
Validation auc = 0.739722
Epoch 1273
Loss = 5.2108e-04, PNorm = 103.7191, GNorm = 0.0105, lr_0 = 9.3664e-04
Loss = 7.9075e-06, PNorm = 103.7198, GNorm = 0.0003, lr_0 = 9.3662e-04
Validation auc = 0.739668
Epoch 1274
Validation auc = 0.739504
Epoch 1275
Validation auc = 0.739340
Epoch 1276
Validation auc = 0.738957
Epoch 1277
Validation auc = 0.738902
Epoch 1278
Loss = 7.2384e-05, PNorm = 103.7284, GNorm = 0.0015, lr_0 = 9.3641e-04
Validation auc = 0.738629
Epoch 1279
Validation auc = 0.739176
Epoch 1280
Validation auc = 0.739886
Epoch 1281
Validation auc = 0.742346
Epoch 1282
Validation auc = 0.743385
Epoch 1283
Loss = 2.7261e-01, PNorm = 103.7679, GNorm = 2.8138, lr_0 = 9.3616e-04
Validation auc = 0.749836
Epoch 1284
Validation auc = 0.753225
Epoch 1285
Validation auc = 0.755030
Epoch 1286
Validation auc = 0.732397
Epoch 1287
Loss = 2.5877e-03, PNorm = 103.8720, GNorm = 0.0847, lr_0 = 9.3594e-04
Loss = 2.5174e-04, PNorm = 103.8797, GNorm = 0.0106, lr_0 = 9.3592e-04
Validation auc = 0.720151
Epoch 1288
Validation auc = 0.713645
Epoch 1289
Validation auc = 0.710748
Epoch 1290
Validation auc = 0.709600
Epoch 1291
Validation auc = 0.715668
Epoch 1292
Loss = 1.8971e-02, PNorm = 103.9641, GNorm = 0.8302, lr_0 = 9.3571e-04
Validation auc = 0.719058
Epoch 1293
Validation auc = 0.722502
Epoch 1294
Validation auc = 0.724470
Epoch 1295
Validation auc = 0.725836
Epoch 1296
Validation auc = 0.725946
Epoch 1297
Loss = 2.4378e-03, PNorm = 104.0513, GNorm = 0.0674, lr_0 = 9.3546e-04
Validation auc = 0.725727
Epoch 1298
Validation auc = 0.725891
Epoch 1299
Validation auc = 0.727148
Epoch 1300
Validation auc = 0.728515
Epoch 1301
Loss = 1.5909e-03, PNorm = 104.0953, GNorm = 0.0299, lr_0 = 9.3524e-04
Loss = 5.6620e-04, PNorm = 104.0981, GNorm = 0.0163, lr_0 = 9.3523e-04
Validation auc = 0.728898
Epoch 1302
Validation auc = 0.729937
Epoch 1303
Validation auc = 0.731139
Epoch 1304
Validation auc = 0.731686
Epoch 1305
Validation auc = 0.732014
Epoch 1306
Loss = 1.6101e-03, PNorm = 104.1312, GNorm = 0.0199, lr_0 = 9.3499e-04
Loss = 1.1071e-03, PNorm = 104.1335, GNorm = 0.0444, lr_0 = 9.3498e-04
Validation auc = 0.731303
Epoch 1307
Validation auc = 0.733927
Epoch 1308
Validation auc = 0.730593
Epoch 1309
Validation auc = 0.753717
Epoch 1310
Validation auc = 0.745408
Epoch 1311
Loss = 1.6886e-02, PNorm = 104.5004, GNorm = 0.1960, lr_0 = 9.3476e-04
Validation auc = 0.671824
Epoch 1312
Validation auc = 0.698447
Epoch 1313
Validation auc = 0.704844
Epoch 1314
Validation auc = 0.705008
Epoch 1315
Validation auc = 0.711787
Epoch 1316
Loss = 1.7498e-02, PNorm = 105.0629, GNorm = 0.2263, lr_0 = 9.3451e-04
Validation auc = 0.719112
Epoch 1317
Validation auc = 0.726219
Epoch 1318
Validation auc = 0.727969
Epoch 1319
Validation auc = 0.727203
Epoch 1320
Loss = 1.9557e-02, PNorm = 105.3353, GNorm = 0.6716, lr_0 = 9.3430e-04
Loss = 2.1064e-03, PNorm = 105.3516, GNorm = 0.0728, lr_0 = 9.3428e-04
Validation auc = 0.729281
Epoch 1321
Validation auc = 0.725235
Epoch 1322
Validation auc = 0.722611
Epoch 1323
Validation auc = 0.719440
Epoch 1324
Validation auc = 0.728515
Epoch 1325
Loss = 2.5807e-02, PNorm = 105.5036, GNorm = 1.0794, lr_0 = 9.3407e-04
Validation auc = 0.739285
Epoch 1326
Validation auc = 0.747759
Epoch 1327
Validation auc = 0.755467
Epoch 1328
Validation auc = 0.761316
Epoch 1329
Validation auc = 0.766018
Epoch 1330
Loss = 6.0271e-04, PNorm = 105.6082, GNorm = 0.0138, lr_0 = 9.3382e-04
Validation auc = 0.769407
Epoch 1331
Validation auc = 0.771758
Epoch 1332
Validation auc = 0.771594
Epoch 1333
Validation auc = 0.764706
Epoch 1334
Loss = 1.5397e-02, PNorm = 105.6583, GNorm = 0.7902, lr_0 = 9.3360e-04
Loss = 6.6965e-03, PNorm = 105.6656, GNorm = 0.3101, lr_0 = 9.3359e-04
Validation auc = 0.756943
Epoch 1335
Validation auc = 0.757380
Epoch 1336
Validation auc = 0.762464
Epoch 1337
Validation auc = 0.762136
Epoch 1338
Validation auc = 0.759786
Epoch 1339
Loss = 6.8212e-04, PNorm = 105.7485, GNorm = 0.0125, lr_0 = 9.3336e-04
Loss = 3.0494e-04, PNorm = 105.7524, GNorm = 0.0071, lr_0 = 9.3334e-04
Validation auc = 0.757654
Epoch 1340
Validation auc = 0.758364
Epoch 1341
Validation auc = 0.763284
Epoch 1342
Validation auc = 0.764214
Epoch 1343
Validation auc = 0.762027
Epoch 1344
Loss = 6.5082e-02, PNorm = 105.8731, GNorm = 0.8233, lr_0 = 9.3312e-04
Validation auc = 0.759294
Epoch 1345
Validation auc = 0.755795
Epoch 1346
Validation auc = 0.762355
Epoch 1347
Validation auc = 0.762300
Epoch 1348
Validation auc = 0.764761
Epoch 1349
Loss = 2.1774e-02, PNorm = 106.0725, GNorm = 0.2415, lr_0 = 9.3288e-04
Validation auc = 0.765089
Epoch 1350
Validation auc = 0.763558
Epoch 1351
Validation auc = 0.762410
Epoch 1352
Validation auc = 0.758802
Epoch 1353
Loss = 3.5690e-02, PNorm = 106.3783, GNorm = 0.3436, lr_0 = 9.3266e-04
Loss = 3.5602e-04, PNorm = 106.3983, GNorm = 0.0122, lr_0 = 9.3264e-04
Validation auc = 0.756615
Epoch 1354
Validation auc = 0.753553
Epoch 1355
Validation auc = 0.749180
Epoch 1356
Validation auc = 0.745189
Epoch 1357
Validation auc = 0.743986
Epoch 1358
Loss = 1.0581e-01, PNorm = 106.5928, GNorm = 3.6765, lr_0 = 9.3241e-04
Validation auc = 0.723978
Epoch 1359
Validation auc = 0.715231
Epoch 1360
Validation auc = 0.705718
Epoch 1361
Validation auc = 0.696753
Epoch 1362
Validation auc = 0.709381
Epoch 1363
Loss = 3.5911e-02, PNorm = 106.8267, GNorm = 1.4183, lr_0 = 9.3218e-04
Validation auc = 0.713208
Epoch 1364
Validation auc = 0.694511
Epoch 1365
Validation auc = 0.677017
Epoch 1366
Validation auc = 0.671660
Epoch 1367
Loss = 7.4569e-02, PNorm = 107.1582, GNorm = 0.4855, lr_0 = 9.3197e-04
Loss = 6.4914e-02, PNorm = 107.1872, GNorm = 1.1096, lr_0 = 9.3195e-04
Validation auc = 0.679587
Epoch 1368
Validation auc = 0.705609
Epoch 1369
Validation auc = 0.731303
Epoch 1370
Validation auc = 0.749781
Epoch 1371
Validation auc = 0.761644
Epoch 1372
Loss = 1.4265e-01, PNorm = 107.5723, GNorm = 2.7473, lr_0 = 9.3172e-04
Loss = 1.4478e-01, PNorm = 107.6030, GNorm = 5.3174, lr_0 = 9.3170e-04
Validation auc = 0.744752
Epoch 1373
Validation auc = 0.733818
Epoch 1374
Validation auc = 0.728898
Epoch 1375
Validation auc = 0.722666
Epoch 1376
Validation auc = 0.746228
Epoch 1377
Loss = 2.0552e-02, PNorm = 107.9749, GNorm = 0.3056, lr_0 = 9.3149e-04
Validation auc = 0.767931
Epoch 1378
Validation auc = 0.780942
Epoch 1379
Validation auc = 0.788377
Epoch 1380
Validation auc = 0.789525
Epoch 1381
Validation auc = 0.782965
Epoch 1382
Loss = 1.2986e-02, PNorm = 108.2645, GNorm = 0.2303, lr_0 = 9.3124e-04
Validation auc = 0.774437
Epoch 1383
Validation auc = 0.765362
Epoch 1384
Validation auc = 0.756724
Epoch 1385
Validation auc = 0.750492
Epoch 1386
Loss = 6.1783e-02, PNorm = 108.4070, GNorm = 0.7297, lr_0 = 9.3102e-04
Loss = 1.4268e-04, PNorm = 108.4135, GNorm = 0.0040, lr_0 = 9.3101e-04
Validation auc = 0.744041
Epoch 1387
Validation auc = 0.736223
Epoch 1388
Validation auc = 0.729281
Epoch 1389
Validation auc = 0.726110
Epoch 1390
Validation auc = 0.724306
Epoch 1391
Loss = 4.9920e-03, PNorm = 108.4872, GNorm = 0.0868, lr_0 = 9.3078e-04
Validation auc = 0.722392
Epoch 1392
Validation auc = 0.713481
Epoch 1393
Validation auc = 0.694621
Epoch 1394
Validation auc = 0.697354
Epoch 1395
Validation auc = 0.715996
Epoch 1396
Loss = 3.2450e-02, PNorm = 108.5785, GNorm = 1.4004, lr_0 = 9.3055e-04
Validation auc = 0.731959
Epoch 1397
Validation auc = 0.740706
Epoch 1398
Validation auc = 0.745134
Epoch 1399
Validation auc = 0.743330
Epoch 1400
Loss = 3.2347e-03, PNorm = 108.6721, GNorm = 0.0316, lr_0 = 9.3033e-04
Loss = 3.0576e-03, PNorm = 108.6800, GNorm = 0.0619, lr_0 = 9.3032e-04
Validation auc = 0.738082
Epoch 1401
Validation auc = 0.734802
Epoch 1402
Validation auc = 0.732069
Epoch 1403
Validation auc = 0.730265
Epoch 1404
Validation auc = 0.729554
Epoch 1405
Loss = 1.3438e-03, PNorm = 108.7607, GNorm = 0.0203, lr_0 = 9.3008e-04
Loss = 1.3744e-03, PNorm = 108.7645, GNorm = 0.0400, lr_0 = 9.3007e-04
Validation auc = 0.728843
Epoch 1406
Validation auc = 0.721900
Epoch 1407
Validation auc = 0.714739
Epoch 1408
Validation auc = 0.707140
Epoch 1409
Validation auc = 0.704352
Epoch 1410
Loss = 4.7395e-02, PNorm = 108.8050, GNorm = 2.1745, lr_0 = 9.2985e-04
Validation auc = 0.713481
Epoch 1411
Validation auc = 0.717417
Epoch 1412
Validation auc = 0.718237
Epoch 1413
Validation auc = 0.712060
Epoch 1414
Validation auc = 0.705390
Epoch 1415
Loss = 5.1232e-02, PNorm = 108.8570, GNorm = 0.7047, lr_0 = 9.2961e-04
Validation auc = 0.710420
Epoch 1416
Validation auc = 0.722338
Epoch 1417
Validation auc = 0.726164
Epoch 1418
Validation auc = 0.729171
Epoch 1419
Loss = 9.2124e-03, PNorm = 108.9156, GNorm = 0.1490, lr_0 = 9.2939e-04
Loss = 5.0446e-04, PNorm = 108.9200, GNorm = 0.0132, lr_0 = 9.2938e-04
Validation auc = 0.731522
Epoch 1420
Validation auc = 0.719276
Epoch 1421
Validation auc = 0.710857
Epoch 1422
Validation auc = 0.705718
Epoch 1423
Validation auc = 0.702821
Epoch 1424
Loss = 3.3231e-02, PNorm = 108.9767, GNorm = 0.7207, lr_0 = 9.2914e-04
Validation auc = 0.698010
Epoch 1425
Validation auc = 0.691395
Epoch 1426
Validation auc = 0.680735
Epoch 1427
Validation auc = 0.675323
Epoch 1428
Validation auc = 0.671660
Epoch 1429
Loss = 1.5169e-02, PNorm = 109.0553, GNorm = 0.1088, lr_0 = 9.2891e-04
Validation auc = 0.670894
Epoch 1430
Validation auc = 0.671058
Epoch 1431
Validation auc = 0.671277
Epoch 1432
Validation auc = 0.671824
Epoch 1433
Loss = 2.0435e-03, PNorm = 109.1320, GNorm = 0.0433, lr_0 = 9.2868e-04
Validation auc = 0.672589
Epoch 1434
Validation auc = 0.675869
Epoch 1435
Validation auc = 0.677236
Epoch 1436
Validation auc = 0.679259
Epoch 1437
Validation auc = 0.681664
Epoch 1438
Loss = 1.4972e-04, PNorm = 109.1800, GNorm = 0.0090, lr_0 = 9.2845e-04
Loss = 1.9272e-06, PNorm = 109.1823, GNorm = 0.0001, lr_0 = 9.2844e-04
Validation auc = 0.683578
Epoch 1439
Validation auc = 0.684726
Epoch 1440
Validation auc = 0.685764
Epoch 1441
Validation auc = 0.688279
Epoch 1442
Validation auc = 0.687896
Epoch 1443
Loss = 2.7790e-04, PNorm = 109.2105, GNorm = 0.0093, lr_0 = 9.2822e-04
Validation auc = 0.688443
Epoch 1444
Validation auc = 0.688498
Epoch 1445
Validation auc = 0.689318
Epoch 1446
Validation auc = 0.689591
Epoch 1447
Validation auc = 0.690630
Epoch 1448
Loss = 1.1206e-03, PNorm = 109.2457, GNorm = 0.0628, lr_0 = 9.2798e-04
Validation auc = 0.691942
Epoch 1449
Validation auc = 0.695605
Epoch 1450
Validation auc = 0.705117
Epoch 1451
Validation auc = 0.720588
Epoch 1452
Loss = 1.5644e-01, PNorm = 109.3326, GNorm = 2.2810, lr_0 = 9.2776e-04
Loss = 2.3246e-06, PNorm = 109.3482, GNorm = 0.0001, lr_0 = 9.2775e-04
Validation auc = 0.734583
Epoch 1453
Validation auc = 0.748579
Epoch 1454
Validation auc = 0.752023
Epoch 1455
Validation auc = 0.739668
Epoch 1456
Validation auc = 0.732561
Epoch 1457
Loss = 1.1555e-01, PNorm = 109.5105, GNorm = 0.2682, lr_0 = 9.2752e-04
Loss = 6.7383e-03, PNorm = 109.5198, GNorm = 0.1858, lr_0 = 9.2750e-04
Validation auc = 0.734857
Epoch 1458
Validation auc = 0.726875
Epoch 1459
Validation auc = 0.724251
Epoch 1460
Validation auc = 0.720534
Epoch 1461
Validation auc = 0.718073
Epoch 1462
Loss = 2.4066e-03, PNorm = 109.6506, GNorm = 0.0540, lr_0 = 9.2729e-04
Validation auc = 0.718401
Epoch 1463
Validation auc = 0.719495
Epoch 1464
Validation auc = 0.720916
Epoch 1465
Validation auc = 0.721682
Epoch 1466
Loss = 3.5019e-02, PNorm = 109.7533, GNorm = 0.0023, lr_0 = 9.2706e-04
Validation auc = 0.715832
Epoch 1467
Validation auc = 0.711623
Epoch 1468
Validation auc = 0.710147
Epoch 1469
Validation auc = 0.713427
Epoch 1470
Validation auc = 0.718729
Epoch 1471
Loss = 1.0019e-03, PNorm = 109.8193, GNorm = 0.0151, lr_0 = 9.2683e-04
Loss = 5.8362e-03, PNorm = 109.8238, GNorm = 0.1233, lr_0 = 9.2681e-04
Validation auc = 0.723158
Epoch 1472
Validation auc = 0.720042
Epoch 1473
Validation auc = 0.716215
Epoch 1474
Validation auc = 0.713481
Epoch 1475
Validation auc = 0.711349
Epoch 1476
Loss = 3.1370e-03, PNorm = 109.8861, GNorm = 0.0528, lr_0 = 9.2660e-04
Validation auc = 0.710420
Epoch 1477
Validation auc = 0.709381
Epoch 1478
Validation auc = 0.706101
Epoch 1479
Validation auc = 0.704242
Epoch 1480
Validation auc = 0.703586
Epoch 1481
Loss = 3.7953e-03, PNorm = 109.9340, GNorm = 0.1298, lr_0 = 9.2635e-04
Validation auc = 0.703532
Epoch 1482
Validation auc = 0.696862
Epoch 1483
Validation auc = 0.689427
Epoch 1484
Validation auc = 0.696315
Epoch 1485
Loss = 1.1406e-03, PNorm = 109.9595, GNorm = 0.0134, lr_0 = 9.2614e-04
Loss = 2.4686e-02, PNorm = 109.9633, GNorm = 1.6274, lr_0 = 9.2612e-04
Validation auc = 0.697354
Epoch 1486
Validation auc = 0.697463
Epoch 1487
Validation auc = 0.698119
Epoch 1488
Validation auc = 0.699486
Epoch 1489
Validation auc = 0.700579
Epoch 1490
Loss = 2.5051e-03, PNorm = 110.0098, GNorm = 0.0244, lr_0 = 9.2589e-04
Loss = 2.0464e-05, PNorm = 110.0122, GNorm = 0.0009, lr_0 = 9.2587e-04
Validation auc = 0.701290
Epoch 1491
Validation auc = 0.698502
Epoch 1492
Validation auc = 0.696534
Epoch 1493
Validation auc = 0.694511
Epoch 1494
Validation auc = 0.692981
Epoch 1495
Loss = 1.4121e-03, PNorm = 110.0371, GNorm = 0.0408, lr_0 = 9.2566e-04
Validation auc = 0.691778
Epoch 1496
Validation auc = 0.696151
Epoch 1497
Validation auc = 0.700142
Epoch 1498
Validation auc = 0.702602
Epoch 1499
Loss = 6.5707e-04, PNorm = 110.0756, GNorm = 0.0002, lr_0 = 9.2543e-04
Validation auc = 0.704297
Epoch 1500
Validation auc = 0.705882
Epoch 1501
Validation auc = 0.706921
Epoch 1502
Validation auc = 0.707632
Epoch 1503
Validation auc = 0.709818
Epoch 1504
Loss = 6.8799e-04, PNorm = 110.0952, GNorm = 0.0425, lr_0 = 9.2520e-04
Loss = 9.9341e-08, PNorm = 110.0964, GNorm = 0.0000, lr_0 = 9.2518e-04
Validation auc = 0.710365
Epoch 1505
Validation auc = 0.710529
Epoch 1506
Validation auc = 0.708014
Epoch 1507
Validation auc = 0.703969
Epoch 1508
Validation auc = 0.701673
Epoch 1509
Loss = 5.8683e-04, PNorm = 110.1012, GNorm = 0.0152, lr_0 = 9.2497e-04
Validation auc = 0.700197
Epoch 1510
Validation auc = 0.699158
Epoch 1511
Validation auc = 0.697901
Epoch 1512
Validation auc = 0.697627
Epoch 1513
Validation auc = 0.698065
Epoch 1514
Loss = 2.3387e-03, PNorm = 110.1256, GNorm = 0.1188, lr_0 = 9.2472e-04
Validation auc = 0.698338
Epoch 1515
Validation auc = 0.699595
Epoch 1516
Validation auc = 0.701400
Epoch 1517
Validation auc = 0.702602
Epoch 1518
Loss = 5.4930e-04, PNorm = 110.1535, GNorm = 0.0245, lr_0 = 9.2451e-04
Loss = 1.4357e-04, PNorm = 110.1553, GNorm = 0.0060, lr_0 = 9.2449e-04
Validation auc = 0.703258
Epoch 1519
Validation auc = 0.703696
Epoch 1520
Validation auc = 0.694675
Epoch 1521
Validation auc = 0.688552
Epoch 1522
Validation auc = 0.684288
Epoch 1523
Loss = 5.8762e-03, PNorm = 110.1915, GNorm = 0.0776, lr_0 = 9.2427e-04
Loss = 4.5062e-04, PNorm = 110.1944, GNorm = 0.0135, lr_0 = 9.2425e-04
Validation auc = 0.682812
Epoch 1524
Validation auc = 0.683414
Epoch 1525
Validation auc = 0.683578
Epoch 1526
Validation auc = 0.684015
Epoch 1527
Validation auc = 0.684343
Epoch 1528
Loss = 5.4979e-04, PNorm = 110.2243, GNorm = 0.0447, lr_0 = 9.2404e-04
Validation auc = 0.685436
Epoch 1529
Validation auc = 0.685382
Epoch 1530
Validation auc = 0.685710
Epoch 1531
Validation auc = 0.685983
Epoch 1532
Validation auc = 0.686256
Epoch 1533
Loss = 8.0148e-05, PNorm = 110.2429, GNorm = 0.0024, lr_0 = 9.2379e-04
Validation auc = 0.686475
Epoch 1534
Validation auc = 0.686858
Epoch 1535
Validation auc = 0.686967
Epoch 1536
Validation auc = 0.687295
Epoch 1537
Loss = 6.6573e-05, PNorm = 110.2563, GNorm = 0.0023, lr_0 = 9.2358e-04
Loss = 1.3073e-05, PNorm = 110.2574, GNorm = 0.0007, lr_0 = 9.2356e-04
Validation auc = 0.687404
Epoch 1538
Validation auc = 0.687568
Epoch 1539
Validation auc = 0.687514
Epoch 1540
Validation auc = 0.687404
Epoch 1541
Validation auc = 0.687404
Epoch 1542
Loss = 7.4248e-03, PNorm = 110.2716, GNorm = 0.6429, lr_0 = 9.2335e-04
Validation auc = 0.687131
Epoch 1543
Validation auc = 0.686967
Epoch 1544
Validation auc = 0.685874
Epoch 1545
Validation auc = 0.684671
Epoch 1546
Validation auc = 0.684944
Epoch 1547
Loss = 4.5199e-02, PNorm = 110.2839, GNorm = 2.3942, lr_0 = 9.2310e-04
Validation auc = 0.685764
Epoch 1548
Validation auc = 0.689263
Epoch 1549
Validation auc = 0.692051
Epoch 1550
Validation auc = 0.692762
Epoch 1551
Loss = 1.4014e-01, PNorm = 110.3314, GNorm = 1.7169, lr_0 = 9.2289e-04
Loss = 4.9869e-06, PNorm = 110.3323, GNorm = 0.0002, lr_0 = 9.2287e-04
Validation auc = 0.693199
Epoch 1552
Validation auc = 0.688388
Epoch 1553
Validation auc = 0.687951
Epoch 1554
Validation auc = 0.693145
Epoch 1555
Validation auc = 0.696534
Epoch 1556
Loss = 1.0334e-03, PNorm = 110.3803, GNorm = 0.0313, lr_0 = 9.2264e-04
Loss = 2.3127e-04, PNorm = 110.3841, GNorm = 0.0088, lr_0 = 9.2263e-04
Validation auc = 0.698721
Epoch 1557
Validation auc = 0.700033
Epoch 1558
Validation auc = 0.702493
Epoch 1559
Validation auc = 0.703696
Epoch 1560
Validation auc = 0.704789
Epoch 1561
Loss = 1.2030e-02, PNorm = 110.4254, GNorm = 0.4617, lr_0 = 9.2242e-04
Validation auc = 0.703641
Epoch 1562
Validation auc = 0.702930
Epoch 1563
Validation auc = 0.700087
Epoch 1564
Validation auc = 0.700251
Epoch 1565
Validation auc = 0.702001
Epoch 1566
Loss = 1.9624e-01, PNorm = 110.5351, GNorm = 4.4622, lr_0 = 9.2217e-04
Validation auc = 0.706866
Epoch 1567
Validation auc = 0.717691
Epoch 1568
Validation auc = 0.730101
Epoch 1569
Validation auc = 0.734037
Epoch 1570
Loss = 2.1034e-02, PNorm = 110.7449, GNorm = 0.6089, lr_0 = 9.2196e-04
Loss = 3.8938e-02, PNorm = 110.7629, GNorm = 1.4727, lr_0 = 9.2194e-04
Validation auc = 0.736716
Epoch 1571
Validation auc = 0.740816
Epoch 1572
Validation auc = 0.738356
Epoch 1573
Validation auc = 0.739449
Epoch 1574
Validation auc = 0.739449
Epoch 1575
Loss = 3.3721e-02, PNorm = 110.9633, GNorm = 1.0577, lr_0 = 9.2173e-04
Validation auc = 0.741472
Epoch 1576
Validation auc = 0.749125
Epoch 1577
Validation auc = 0.711841
Epoch 1578
Validation auc = 0.688552
Epoch 1579
Validation auc = 0.689318
Epoch 1580
Loss = 6.1237e-02, PNorm = 111.1080, GNorm = 2.3216, lr_0 = 9.2148e-04
Validation auc = 0.692981
Epoch 1581
Validation auc = 0.691997
Epoch 1582
Validation auc = 0.690903
Epoch 1583
Validation auc = 0.690192
Epoch 1584
Loss = 2.2615e-02, PNorm = 111.2566, GNorm = 1.5837, lr_0 = 9.2127e-04
Loss = 1.3549e-03, PNorm = 111.2652, GNorm = 0.0328, lr_0 = 9.2125e-04
Validation auc = 0.687568
Epoch 1585
Validation auc = 0.681937
Epoch 1586
Validation auc = 0.681391
Epoch 1587
Validation auc = 0.693801
Epoch 1588
Validation auc = 0.704352
Epoch 1589
Loss = 9.3645e-02, PNorm = 111.4432, GNorm = 1.1565, lr_0 = 9.2103e-04
Loss = 1.8716e-04, PNorm = 111.4550, GNorm = 0.0118, lr_0 = 9.2101e-04
Validation auc = 0.708288
Epoch 1590
Validation auc = 0.711732
Epoch 1591
Validation auc = 0.700962
Epoch 1592
Validation auc = 0.693145
Epoch 1593
Validation auc = 0.690083
Epoch 1594
Loss = 4.6136e-02, PNorm = 111.5993, GNorm = 1.0780, lr_0 = 9.2080e-04
Validation auc = 0.693637
Epoch 1595
Validation auc = 0.695113
Epoch 1596
Validation auc = 0.696042
Epoch 1597
Validation auc = 0.697299
Epoch 1598
Validation auc = 0.698885
Epoch 1599
Loss = 1.7426e-03, PNorm = 111.7535, GNorm = 0.0533, lr_0 = 9.2055e-04
Validation auc = 0.697955
Epoch 1600
Validation auc = 0.695987
Epoch 1601
Validation auc = 0.695167
Epoch 1602
Validation auc = 0.693965
Epoch 1603
Loss = 8.6104e-04, PNorm = 111.8327, GNorm = 0.0279, lr_0 = 9.2034e-04
Loss = 9.6765e-04, PNorm = 111.8367, GNorm = 0.0543, lr_0 = 9.2032e-04
Validation auc = 0.692489
Epoch 1604
Validation auc = 0.691887
Epoch 1605
Validation auc = 0.691997
Epoch 1606
Validation auc = 0.691559
Epoch 1607
Validation auc = 0.691286
Epoch 1608
Loss = 4.6224e-04, PNorm = 111.8868, GNorm = 0.0082, lr_0 = 9.2010e-04
Validation auc = 0.690575
Epoch 1609
Validation auc = 0.690684
Epoch 1610
Validation auc = 0.691231
Epoch 1611
Validation auc = 0.691286
Epoch 1612
Validation auc = 0.679313
Epoch 1613
Loss = 6.6769e-04, PNorm = 111.9165, GNorm = 0.0157, lr_0 = 9.1987e-04
Validation auc = 0.686694
Epoch 1614
Validation auc = 0.700798
Epoch 1615
Validation auc = 0.709272
Epoch 1616
Validation auc = 0.714356
Epoch 1617
Loss = 1.1729e-03, PNorm = 111.9660, GNorm = 0.0430, lr_0 = 9.1966e-04
Loss = 1.5295e-01, PNorm = 111.9720, GNorm = 5.1988, lr_0 = 9.1964e-04
Validation auc = 0.713536
Epoch 1618
Validation auc = 0.702766
Epoch 1619
Validation auc = 0.693145
Epoch 1620
Validation auc = 0.687186
Epoch 1621
Validation auc = 0.685436
Epoch 1622
Loss = 1.0798e-02, PNorm = 112.0968, GNorm = 0.3894, lr_0 = 9.1941e-04
Loss = 1.9877e-04, PNorm = 112.1075, GNorm = 0.0074, lr_0 = 9.1939e-04
Validation auc = 0.689427
Epoch 1623
Validation auc = 0.688443
Epoch 1624
Validation auc = 0.680407
Epoch 1625
Validation auc = 0.684944
Epoch 1626
Validation auc = 0.691832
Epoch 1627
Loss = 1.0733e-01, PNorm = 112.2567, GNorm = 1.7730, lr_0 = 9.1918e-04
Validation auc = 0.697682
Epoch 1628
Validation auc = 0.689427
Epoch 1629
Validation auc = 0.674010
Epoch 1630
Validation auc = 0.686639
Epoch 1631
Validation auc = 0.685327
Epoch 1632
Loss = 5.4111e-02, PNorm = 112.5841, GNorm = 0.5464, lr_0 = 9.1894e-04
Validation auc = 0.685710
Epoch 1633
Validation auc = 0.689919
Epoch 1634
Validation auc = 0.698830
Epoch 1635
Validation auc = 0.705062
Epoch 1636
Loss = 9.5578e-02, PNorm = 112.9439, GNorm = 8.4295, lr_0 = 9.1873e-04
Loss = 7.5591e-02, PNorm = 112.9642, GNorm = 1.0259, lr_0 = 9.1871e-04
Validation auc = 0.704898
Epoch 1637
Validation auc = 0.703368
Epoch 1638
Validation auc = 0.699049
Epoch 1639
Validation auc = 0.699759
Epoch 1640
Validation auc = 0.694730
Epoch 1641
Loss = 2.4608e-02, PNorm = 113.2723, GNorm = 0.8013, lr_0 = 9.1848e-04
Validation auc = 0.684835
Epoch 1642
Validation auc = 0.678931
Epoch 1643
Validation auc = 0.673245
Epoch 1644
Validation auc = 0.670238
Epoch 1645
Validation auc = 0.677892
Epoch 1646
Loss = 5.5156e-04, PNorm = 113.4802, GNorm = 0.0243, lr_0 = 9.1825e-04
Validation auc = 0.680899
Epoch 1647
Validation auc = 0.681992
Epoch 1648
Validation auc = 0.681008
Epoch 1649
Validation auc = 0.680079
Epoch 1650
Loss = 1.2895e-02, PNorm = 113.5920, GNorm = 0.0804, lr_0 = 9.1804e-04
Loss = 9.1409e-05, PNorm = 113.6004, GNorm = 0.0030, lr_0 = 9.1803e-04
Validation auc = 0.679915
Epoch 1651
Validation auc = 0.679751
Epoch 1652
Validation auc = 0.693145
Epoch 1653
Validation auc = 0.706429
Epoch 1654
Validation auc = 0.714793
Epoch 1655
Loss = 5.3071e-03, PNorm = 113.6903, GNorm = 0.0352, lr_0 = 9.1780e-04
Loss = 3.2850e-04, PNorm = 113.6968, GNorm = 0.0088, lr_0 = 9.1778e-04
Validation auc = 0.717691
Epoch 1656
Validation auc = 0.719550
Epoch 1657
Validation auc = 0.719331
Epoch 1658
Validation auc = 0.718183
Epoch 1659
Validation auc = 0.710857
Epoch 1660
Loss = 3.7761e-04, PNorm = 113.7591, GNorm = 0.0315, lr_0 = 9.1757e-04
Validation auc = 0.703860
Epoch 1661
Validation auc = 0.695769
Epoch 1662
Validation auc = 0.689810
Epoch 1663
Validation auc = 0.686967
Epoch 1664
Validation auc = 0.684780
Epoch 1665
Loss = 2.2818e-03, PNorm = 113.8205, GNorm = 0.1599, lr_0 = 9.1733e-04
Validation auc = 0.681555
Epoch 1666
Validation auc = 0.681828
Epoch 1667
Validation auc = 0.681500
Epoch 1668
Validation auc = 0.681992
Epoch 1669
Loss = 4.0932e-03, PNorm = 113.8528, GNorm = 0.0040, lr_0 = 9.1712e-04
Loss = 4.5697e-07, PNorm = 113.8548, GNorm = 0.0000, lr_0 = 9.1710e-04
Validation auc = 0.678548
Epoch 1670
Validation auc = 0.676908
Epoch 1671
Validation auc = 0.675159
Epoch 1672
Validation auc = 0.674995
Epoch 1673
Validation auc = 0.671660
Epoch 1674
Loss = 2.1264e-04, PNorm = 113.8783, GNorm = 0.0202, lr_0 = 9.1687e-04
Validation auc = 0.669473
Epoch 1675
Validation auc = 0.669145
Epoch 1676
Validation auc = 0.670074
Epoch 1677
Validation auc = 0.675432
Epoch 1678
Validation auc = 0.678329
Epoch 1679
Loss = 9.0381e-06, PNorm = 113.9084, GNorm = 0.0004, lr_0 = 9.1664e-04
Validation auc = 0.681937
Epoch 1680
Validation auc = 0.683687
Epoch 1681
Validation auc = 0.681828
Epoch 1682
Validation auc = 0.680625
Epoch 1683
Loss = 1.1967e-02, PNorm = 113.9305, GNorm = 0.0002, lr_0 = 9.1642e-04
Validation auc = 0.680352
Epoch 1684
Validation auc = 0.681555
Epoch 1685
Validation auc = 0.683250
Epoch 1686
Validation auc = 0.680133
Epoch 1687
Validation auc = 0.677564
Epoch 1688
Loss = 1.5754e-04, PNorm = 113.9829, GNorm = 0.0072, lr_0 = 9.1619e-04
Loss = 1.5040e-05, PNorm = 113.9870, GNorm = 0.0007, lr_0 = 9.1617e-04
Validation auc = 0.675760
Epoch 1689
Validation auc = 0.674612
Epoch 1690
Validation auc = 0.673682
Epoch 1691
Validation auc = 0.673846
Epoch 1692
Validation auc = 0.673300
Epoch 1693
Loss = 3.0571e-04, PNorm = 114.0228, GNorm = 0.0078, lr_0 = 9.1596e-04
Validation auc = 0.672917
Epoch 1694
Validation auc = 0.672753
Epoch 1695
Validation auc = 0.672644
Epoch 1696
Validation auc = 0.672206
Epoch 1697
Validation auc = 0.672480
Epoch 1698
Loss = 4.6934e-03, PNorm = 114.0305, GNorm = 0.3625, lr_0 = 9.1572e-04
Validation auc = 0.672316
Epoch 1699
Validation auc = 0.671933
Epoch 1700
Validation auc = 0.673628
Epoch 1701
Validation auc = 0.673682
Epoch 1702
Loss = 5.9755e-03, PNorm = 114.0477, GNorm = 0.6762, lr_0 = 9.1551e-04
Loss = 5.7373e-04, PNorm = 114.0501, GNorm = 0.0226, lr_0 = 9.1549e-04
Validation auc = 0.674831
Epoch 1703
Validation auc = 0.676853
Epoch 1704
Validation auc = 0.678220
Epoch 1705
Validation auc = 0.677947
Epoch 1706
Validation auc = 0.680680
Epoch 1707
Loss = 2.0682e-03, PNorm = 114.0885, GNorm = 0.0348, lr_0 = 9.1526e-04
Loss = 5.3815e-05, PNorm = 114.0921, GNorm = 0.0015, lr_0 = 9.1525e-04
Validation auc = 0.683578
Epoch 1708
Validation auc = 0.684944
Epoch 1709
Validation auc = 0.686475
Epoch 1710
Validation auc = 0.691067
Epoch 1711
Validation auc = 0.702821
Epoch 1712
Loss = 1.7934e-02, PNorm = 114.1421, GNorm = 1.2424, lr_0 = 9.1504e-04
Validation auc = 0.702657
Epoch 1713
Validation auc = 0.688990
Epoch 1714
Validation auc = 0.684288
Epoch 1715
Validation auc = 0.687404
Epoch 1716
Loss = 1.3507e-02, PNorm = 114.3585, GNorm = 0.0438, lr_0 = 9.1481e-04
Validation auc = 0.688443
Epoch 1717
Validation auc = 0.686694
Epoch 1718
Validation auc = 0.681719
Epoch 1719
Validation auc = 0.677837
Epoch 1720
Validation auc = 0.678056
Epoch 1721
Loss = 6.1039e-03, PNorm = 114.5773, GNorm = 0.3087, lr_0 = 9.1458e-04
Loss = 1.5491e-03, PNorm = 114.5902, GNorm = 0.0412, lr_0 = 9.1457e-04
Validation auc = 0.678329
Epoch 1722
Validation auc = 0.679805
Epoch 1723
Validation auc = 0.680571
Epoch 1724
Validation auc = 0.681719
Epoch 1725
Validation auc = 0.681500
Epoch 1726
Loss = 7.3047e-04, PNorm = 114.7137, GNorm = 0.0226, lr_0 = 9.1436e-04
Validation auc = 0.683250
Epoch 1727
Validation auc = 0.684452
Epoch 1728
Validation auc = 0.683851
Epoch 1729
Validation auc = 0.682265
Epoch 1730
Validation auc = 0.678548
Epoch 1731
Loss = 3.5560e-02, PNorm = 114.7897, GNorm = 2.4679, lr_0 = 9.1411e-04
Validation auc = 0.673792
Epoch 1732
Validation auc = 0.677291
Epoch 1733
Validation auc = 0.684671
Epoch 1734
Validation auc = 0.689044
Epoch 1735
Loss = 4.6580e-04, PNorm = 114.9151, GNorm = 0.0156, lr_0 = 9.1390e-04
Loss = 1.7813e-02, PNorm = 114.9243, GNorm = 0.5649, lr_0 = 9.1389e-04
Validation auc = 0.691832
Epoch 1736
Validation auc = 0.681828
Epoch 1737
Validation auc = 0.672480
Epoch 1738
Validation auc = 0.688115
Epoch 1739
Validation auc = 0.686584
Epoch 1740
Loss = 2.0809e-03, PNorm = 115.0243, GNorm = 0.0199, lr_0 = 9.1366e-04
Loss = 2.8386e-04, PNorm = 115.0311, GNorm = 0.0129, lr_0 = 9.1364e-04
Validation auc = 0.682757
Epoch 1741
Validation auc = 0.683086
Epoch 1742
Validation auc = 0.705718
Epoch 1743
Validation auc = 0.706921
Epoch 1744
Validation auc = 0.699431
Epoch 1745
Loss = 1.6583e-02, PNorm = 115.1872, GNorm = 0.2768, lr_0 = 9.1343e-04
Validation auc = 0.693965
Epoch 1746
Validation auc = 0.693254
Epoch 1747
Validation auc = 0.694894
Epoch 1748
Validation auc = 0.704352
Epoch 1749
Loss = 8.3960e-03, PNorm = 115.3890, GNorm = 0.0803, lr_0 = 9.1320e-04
Validation auc = 0.717144
Epoch 1750
Validation auc = 0.717745
Epoch 1751
Validation auc = 0.725618
Epoch 1752
Validation auc = 0.720206
Epoch 1753
Validation auc = 0.713536
Epoch 1754
Loss = 1.0132e-02, PNorm = 115.5495, GNorm = 0.4881, lr_0 = 9.1298e-04
Loss = 9.6871e-04, PNorm = 115.5599, GNorm = 0.0245, lr_0 = 9.1296e-04
Validation auc = 0.714356
Epoch 1755
Validation auc = 0.714848
Epoch 1756
Validation auc = 0.714848
Epoch 1757
Validation auc = 0.712333
Epoch 1758
Validation auc = 0.710092
Epoch 1759
Loss = 5.3891e-03, PNorm = 115.6621, GNorm = 0.2834, lr_0 = 9.1275e-04
Validation auc = 0.709272
Epoch 1760
Validation auc = 0.710803
Epoch 1761
Validation auc = 0.710256
Epoch 1762
Validation auc = 0.699295
Epoch 1763
Validation auc = 0.707194
Epoch 1764
Loss = 1.3284e-02, PNorm = 115.7546, GNorm = 0.3029, lr_0 = 9.1251e-04
Validation auc = 0.714629
Epoch 1765
Validation auc = 0.724688
Epoch 1766
Validation auc = 0.728734
Epoch 1767
Validation auc = 0.724360
Epoch 1768
Loss = 4.9425e-02, PNorm = 115.8643, GNorm = 0.4201, lr_0 = 9.1230e-04
Loss = 2.4360e-01, PNorm = 115.8797, GNorm = 2.2022, lr_0 = 9.1228e-04
Validation auc = 0.723103
Epoch 1769
Validation auc = 0.723103
Epoch 1770
Validation auc = 0.722884
Epoch 1771
Validation auc = 0.720534
Epoch 1772
Validation auc = 0.718620
Epoch 1773
Loss = 3.4400e-02, PNorm = 116.1034, GNorm = 0.4890, lr_0 = 9.1206e-04
Loss = 3.9387e-04, PNorm = 116.1177, GNorm = 0.0121, lr_0 = 9.1204e-04
Validation auc = 0.716543
Epoch 1774
Validation auc = 0.714903
Epoch 1775
Validation auc = 0.713536
Epoch 1776
Validation auc = 0.711841
Epoch 1777
Validation auc = 0.710803
Epoch 1778
Loss = 1.7828e-02, PNorm = 116.2640, GNorm = 0.6135, lr_0 = 9.1183e-04
Validation auc = 0.709873
Epoch 1779
Validation auc = 0.707304
Epoch 1780
Validation auc = 0.706156
Epoch 1781
Validation auc = 0.704789
Epoch 1782
Validation auc = 0.703860
Epoch 1783
Loss = 9.1179e-04, PNorm = 116.3944, GNorm = 0.0882, lr_0 = 9.1159e-04
Validation auc = 0.702438
Epoch 1784
Validation auc = 0.701673
Epoch 1785
Validation auc = 0.700962
Epoch 1786
Validation auc = 0.700689
Epoch 1787
Loss = 1.2177e-03, PNorm = 116.4423, GNorm = 0.4340, lr_0 = 9.1138e-04
Loss = 8.6326e-05, PNorm = 116.4440, GNorm = 0.0108, lr_0 = 9.1136e-04
Validation auc = 0.699650
Epoch 1788
Validation auc = 0.699377
Epoch 1789
Validation auc = 0.698666
Epoch 1790
Validation auc = 0.698994
Epoch 1791
Validation auc = 0.698775
Epoch 1792
Loss = 1.9111e-04, PNorm = 116.4618, GNorm = 0.0163, lr_0 = 9.1115e-04
Validation auc = 0.699431
Epoch 1793
Validation auc = 0.699213
Epoch 1794
Validation auc = 0.699923
Epoch 1795
Validation auc = 0.699759
Epoch 1796
Validation auc = 0.699705
Epoch 1797
Loss = 2.8672e-05, PNorm = 116.4774, GNorm = 0.0021, lr_0 = 9.1091e-04
Validation auc = 0.699049
Epoch 1798
Validation auc = 0.698994
Epoch 1799
Validation auc = 0.698666
Epoch 1800
Validation auc = 0.699595
Epoch 1801
Loss = 1.6401e-03, PNorm = 116.4913, GNorm = 0.3360, lr_0 = 9.1070e-04
Loss = 1.1921e-07, PNorm = 116.4928, GNorm = 0.0000, lr_0 = 9.1068e-04
Validation auc = 0.699267
Epoch 1802
Validation auc = 0.699103
Epoch 1803
Validation auc = 0.698885
Epoch 1804
Validation auc = 0.700908
Epoch 1805
Validation auc = 0.701946
Epoch 1806
Loss = 1.2683e-03, PNorm = 116.5171, GNorm = 0.0021, lr_0 = 9.1046e-04
Loss = 1.0331e-06, PNorm = 116.5192, GNorm = 0.0001, lr_0 = 9.1044e-04
Validation auc = 0.703422
Epoch 1807
Validation auc = 0.704024
Epoch 1808
Validation auc = 0.701837
Epoch 1809
Validation auc = 0.698119
Epoch 1810
Validation auc = 0.693035
Epoch 1811
Loss = 1.1688e-03, PNorm = 116.5478, GNorm = 0.2148, lr_0 = 9.1023e-04
Validation auc = 0.689700
Epoch 1812
Validation auc = 0.688388
Epoch 1813
Validation auc = 0.686420
Epoch 1814
Validation auc = 0.689591
Epoch 1815
Validation auc = 0.690138
Epoch 1816
Loss = 1.0429e-04, PNorm = 116.5744, GNorm = 0.0068, lr_0 = 9.0999e-04
Validation auc = 0.689208
Epoch 1817
Validation auc = 0.689864
Epoch 1818
Validation auc = 0.691614
Epoch 1819
Validation auc = 0.695987
Epoch 1820
Loss = 7.5585e-03, PNorm = 116.6057, GNorm = 1.2104, lr_0 = 9.0978e-04
Loss = 2.5663e-04, PNorm = 116.6095, GNorm = 0.0455, lr_0 = 9.0976e-04
Validation auc = 0.698283
Epoch 1821
Validation auc = 0.700251
Epoch 1822
Validation auc = 0.693910
Epoch 1823
Validation auc = 0.683906
Epoch 1824
Validation auc = 0.680352
Epoch 1825
Loss = 4.3848e-04, PNorm = 116.6932, GNorm = 0.0211, lr_0 = 9.0955e-04
Validation auc = 0.682265
Epoch 1826
Validation auc = 0.688334
Epoch 1827
Validation auc = 0.693746
Epoch 1828
Validation auc = 0.695605
Epoch 1829
Validation auc = 0.698721
Epoch 1830
Loss = 5.0081e-03, PNorm = 116.7981, GNorm = 0.2049, lr_0 = 9.0931e-04
Validation auc = 0.701290
Epoch 1831
Validation auc = 0.701072
Epoch 1832
Validation auc = 0.700142
Epoch 1833
Validation auc = 0.700033
Epoch 1834
Loss = 6.3412e-04, PNorm = 116.8530, GNorm = 0.0156, lr_0 = 9.0910e-04
Loss = 2.2112e-04, PNorm = 116.8561, GNorm = 0.0064, lr_0 = 9.0909e-04
Validation auc = 0.700197
Epoch 1835
Validation auc = 0.699049
Epoch 1836
Validation auc = 0.698885
Epoch 1837
Validation auc = 0.698502
Epoch 1838
Validation auc = 0.698338
Epoch 1839
Loss = 4.4181e-04, PNorm = 116.8934, GNorm = 0.0122, lr_0 = 9.0886e-04
Loss = 6.5202e-05, PNorm = 116.8954, GNorm = 0.0027, lr_0 = 9.0884e-04
Validation auc = 0.698229
Epoch 1840
Validation auc = 0.698174
Epoch 1841
Validation auc = 0.700579
Epoch 1842
Validation auc = 0.702821
Epoch 1843
Validation auc = 0.704078
Epoch 1844
Loss = 4.1336e-04, PNorm = 116.9199, GNorm = 0.0093, lr_0 = 9.0863e-04
Validation auc = 0.706156
Epoch 1845
Validation auc = 0.707522
Epoch 1846
Validation auc = 0.708342
Epoch 1847
Validation auc = 0.708616
Epoch 1848
Validation auc = 0.709709
Epoch 1849
Loss = 1.0192e-04, PNorm = 116.9475, GNorm = 0.0026, lr_0 = 9.0839e-04
Validation auc = 0.710256
Epoch 1850
Validation auc = 0.710147
Epoch 1851
Validation auc = 0.709983
Epoch 1852
Validation auc = 0.709490
Epoch 1853
Loss = 5.4271e-04, PNorm = 116.9590, GNorm = 0.0058, lr_0 = 9.0818e-04
Loss = 1.3565e-04, PNorm = 116.9597, GNorm = 0.0039, lr_0 = 9.0817e-04
Validation auc = 0.709490
Epoch 1854
Validation auc = 0.709217
Epoch 1855
Validation auc = 0.709108
Epoch 1856
Validation auc = 0.708834
Epoch 1857
Validation auc = 0.710639
Epoch 1858
Loss = 8.3240e-04, PNorm = 116.9784, GNorm = 0.0095, lr_0 = 9.0794e-04
Validation auc = 0.712989
Epoch 1859
Validation auc = 0.713809
Epoch 1860
Validation auc = 0.714684
Epoch 1861
Validation auc = 0.715285
Epoch 1862
Validation auc = 0.716105
Epoch 1863
Loss = 1.6431e-04, PNorm = 116.9993, GNorm = 0.0059, lr_0 = 9.0772e-04
Validation auc = 0.716433
Epoch 1864
Validation auc = 0.716269
Epoch 1865
Validation auc = 0.716324
Epoch 1866
Validation auc = 0.715832
Epoch 1867
Loss = 2.7116e-04, PNorm = 117.0178, GNorm = 0.0177, lr_0 = 9.0751e-04
Loss = 1.2054e-04, PNorm = 117.0189, GNorm = 0.0096, lr_0 = 9.0749e-04
Validation auc = 0.715285
Epoch 1868
Validation auc = 0.714684
Epoch 1869
Validation auc = 0.714301
Epoch 1870
Validation auc = 0.714356
Epoch 1871
Validation auc = 0.713372
Epoch 1872
Loss = 8.9037e-05, PNorm = 117.0316, GNorm = 0.0020, lr_0 = 9.0727e-04
Loss = 3.7210e-05, PNorm = 117.0325, GNorm = 0.0021, lr_0 = 9.0725e-04
Validation auc = 0.713153
Epoch 1873
Validation auc = 0.713481
Epoch 1874
Validation auc = 0.713809
Epoch 1875
Validation auc = 0.713809
Epoch 1876
Validation auc = 0.712115
Epoch 1877
Loss = 1.8546e-04, PNorm = 117.0426, GNorm = 0.0119, lr_0 = 9.0704e-04
Validation auc = 0.709490
Epoch 1878
Validation auc = 0.708725
Epoch 1879
Validation auc = 0.708014
Epoch 1880
Validation auc = 0.706648
Epoch 1881
Validation auc = 0.705992
Epoch 1882
Loss = 1.1280e-05, PNorm = 117.0539, GNorm = 0.0005, lr_0 = 9.0680e-04
Validation auc = 0.705500
Epoch 1883
Validation auc = 0.704516
Epoch 1884
Validation auc = 0.704078
Epoch 1885
Validation auc = 0.703696
Epoch 1886
Loss = 2.1856e-04, PNorm = 117.0607, GNorm = 0.0041, lr_0 = 9.0659e-04
Loss = 8.3212e-05, PNorm = 117.0614, GNorm = 0.0029, lr_0 = 9.0657e-04
Validation auc = 0.703094
Epoch 1887
Validation auc = 0.702493
Epoch 1888
Validation auc = 0.701946
Epoch 1889
Validation auc = 0.699814
Epoch 1890
Validation auc = 0.698666
Epoch 1891
Loss = 6.1414e-06, PNorm = 117.0773, GNorm = 0.0002, lr_0 = 9.0635e-04
Validation auc = 0.697518
Epoch 1892
Validation auc = 0.695277
Epoch 1893
Validation auc = 0.694019
Epoch 1894
Validation auc = 0.692817
Epoch 1895
Validation auc = 0.693527
Epoch 1896
Loss = 7.5154e-05, PNorm = 117.0926, GNorm = 0.0058, lr_0 = 9.0612e-04
Validation auc = 0.698611
Epoch 1897
Validation auc = 0.700087
Epoch 1898
Validation auc = 0.701892
Epoch 1899
Validation auc = 0.702220
Epoch 1900
Loss = 1.6840e-03, PNorm = 117.1419, GNorm = 0.3323, lr_0 = 9.0592e-04
Loss = 1.3908e-07, PNorm = 117.1455, GNorm = 0.0000, lr_0 = 9.0590e-04
Validation auc = 0.702274
Epoch 1901
Validation auc = 0.704133
Epoch 1902
Validation auc = 0.704242
Epoch 1903
Validation auc = 0.704898
Epoch 1904
Validation auc = 0.705554
Epoch 1905
Loss = 7.3004e-03, PNorm = 117.1987, GNorm = 2.3491, lr_0 = 9.0567e-04
Loss = 2.8708e-05, PNorm = 117.2027, GNorm = 0.0013, lr_0 = 9.0566e-04
Validation auc = 0.703969
Epoch 1906
Validation auc = 0.705718
Epoch 1907
Validation auc = 0.705500
Epoch 1908
Validation auc = 0.704898
Epoch 1909
Validation auc = 0.705609
Epoch 1910
Loss = 3.7998e-05, PNorm = 117.2711, GNorm = 0.0016, lr_0 = 9.0545e-04
Validation auc = 0.703313
Epoch 1911
Validation auc = 0.706839
Epoch 1912
Validation auc = 0.715449
Epoch 1913
Validation auc = 0.710256
Epoch 1914
Validation auc = 0.686912
Epoch 1915
Loss = 3.2622e-01, PNorm = 117.4168, GNorm = 8.7647, lr_0 = 9.0521e-04
Validation auc = 0.744260
Epoch 1916
Validation auc = 0.767029
Epoch 1917
Validation auc = 0.764460
Epoch 1918
Validation auc = 0.766619
Epoch 1919
Loss = 1.3757e-01, PNorm = 117.7807, GNorm = 1.8417, lr_0 = 9.0500e-04
Loss = 3.8521e-03, PNorm = 117.8037, GNorm = 0.1681, lr_0 = 9.0498e-04
Validation auc = 0.766947
Epoch 1920
Validation auc = 0.757654
Epoch 1921
Validation auc = 0.748961
Epoch 1922
Validation auc = 0.747157
Epoch 1923
Validation auc = 0.749727
Epoch 1924
Loss = 2.4310e-02, PNorm = 118.0768, GNorm = 0.2815, lr_0 = 9.0476e-04
Validation auc = 0.749399
Epoch 1925
Validation auc = 0.747321
Epoch 1926
Validation auc = 0.746829
Epoch 1927
Validation auc = 0.747267
Epoch 1928
Validation auc = 0.751203
Epoch 1929
Loss = 1.1506e-03, PNorm = 118.2468, GNorm = 0.0235, lr_0 = 9.0454e-04
Validation auc = 0.753991
Epoch 1930
Validation auc = 0.755303
Epoch 1931
Validation auc = 0.756834
Epoch 1932
Validation auc = 0.759895
Epoch 1933
Loss = 7.7054e-03, PNorm = 118.3395, GNorm = 0.3227, lr_0 = 9.0431e-04
Validation auc = 0.764050
Epoch 1934
Validation auc = 0.765198
Epoch 1935
Validation auc = 0.762902
Epoch 1936
Validation auc = 0.765799
Epoch 1937
Validation auc = 0.769954
Epoch 1938
Loss = 3.6868e-02, PNorm = 118.4442, GNorm = 1.1219, lr_0 = 9.0409e-04
Loss = 9.2458e-05, PNorm = 118.4517, GNorm = 0.0053, lr_0 = 9.0407e-04
Validation auc = 0.772414
Epoch 1939
Validation auc = 0.775476
Epoch 1940
Validation auc = 0.776569
Epoch 1941
Validation auc = 0.775913
Epoch 1942
Validation auc = 0.774929
Epoch 1943
Loss = 2.8856e-02, PNorm = 118.5617, GNorm = 0.7645, lr_0 = 9.0386e-04
Validation auc = 0.775366
Epoch 1944
Validation auc = 0.775749
Epoch 1945
Validation auc = 0.774929
Epoch 1946
Validation auc = 0.771813
Epoch 1947
Validation auc = 0.769462
Epoch 1948
Loss = 5.4919e-04, PNorm = 118.6492, GNorm = 0.0104, lr_0 = 9.0362e-04
Validation auc = 0.767931
Epoch 1949
Validation auc = 0.767002
Epoch 1950
Validation auc = 0.766291
Epoch 1951
Validation auc = 0.766073
Epoch 1952
Loss = 2.7758e-04, PNorm = 118.6901, GNorm = 0.0067, lr_0 = 9.0341e-04
Loss = 7.4270e-04, PNorm = 118.6922, GNorm = 0.0261, lr_0 = 9.0340e-04
Validation auc = 0.765799
Epoch 1953
Validation auc = 0.765690
Epoch 1954
Validation auc = 0.765307
Epoch 1955
Validation auc = 0.765198
Epoch 1956
Validation auc = 0.765089
Epoch 1957
Loss = 4.6722e-04, PNorm = 118.7146, GNorm = 0.0076, lr_0 = 9.0317e-04
Loss = 6.6294e-05, PNorm = 118.7157, GNorm = 0.0036, lr_0 = 9.0316e-04
Validation auc = 0.764815
Epoch 1958
Validation auc = 0.764925
Epoch 1959
Validation auc = 0.765089
Epoch 1960
Validation auc = 0.765471
Epoch 1961
Validation auc = 0.765690
Epoch 1962
Loss = 2.1436e-04, PNorm = 118.7298, GNorm = 0.0084, lr_0 = 9.0295e-04
Validation auc = 0.767002
Epoch 1963
Validation auc = 0.770719
Epoch 1964
Validation auc = 0.767603
Epoch 1965
Validation auc = 0.767713
Epoch 1966
Loss = 2.5449e-02, PNorm = 118.7603, GNorm = 2.1787, lr_0 = 9.0273e-04
Validation auc = 0.773125
Epoch 1967
Validation auc = 0.774874
Epoch 1968
Validation auc = 0.774984
Epoch 1969
Validation auc = 0.774328
Epoch 1970
Validation auc = 0.773672
Epoch 1971
Loss = 2.9223e-04, PNorm = 118.8378, GNorm = 0.0081, lr_0 = 9.0250e-04
Loss = 1.0102e-04, PNorm = 118.8412, GNorm = 0.0045, lr_0 = 9.0249e-04
Validation auc = 0.773180
Epoch 1972
Validation auc = 0.772578
Epoch 1973
Validation auc = 0.772195
Epoch 1974
Validation auc = 0.771485
Epoch 1975
Validation auc = 0.769353
Epoch 1976
Loss = 1.0082e-04, PNorm = 118.8666, GNorm = 0.0030, lr_0 = 9.0228e-04
Validation auc = 0.767549
Epoch 1977
Validation auc = 0.766947
Epoch 1978
Validation auc = 0.766455
Epoch 1979
Validation auc = 0.765909
Epoch 1980
Validation auc = 0.765471
Epoch 1981
Loss = 1.9867e-03, PNorm = 118.8837, GNorm = 0.0580, lr_0 = 9.0204e-04
Validation auc = 0.765362
Epoch 1982
Validation auc = 0.765198
Epoch 1983
Validation auc = 0.765034
Epoch 1984
Validation auc = 0.764925
Epoch 1985
Loss = 9.0818e-04, PNorm = 118.8952, GNorm = 0.0444, lr_0 = 9.0183e-04
Loss = 1.3013e-05, PNorm = 118.8960, GNorm = 0.0008, lr_0 = 9.0181e-04
Validation auc = 0.764925
Epoch 1986
Validation auc = 0.763886
Epoch 1987
Validation auc = 0.763230
Epoch 1988
Validation auc = 0.763558
Epoch 1989
Validation auc = 0.758009
Epoch 1990
Loss = 3.5997e-04, PNorm = 118.9205, GNorm = 0.0050, lr_0 = 9.0159e-04
Loss = 9.9654e-05, PNorm = 118.9221, GNorm = 0.0030, lr_0 = 9.0157e-04
Validation auc = 0.758009
Epoch 1991
Validation auc = 0.758146
Epoch 1992
Validation auc = 0.757681
Epoch 1993
Validation auc = 0.757872
Epoch 1994
Validation auc = 0.757872
Epoch 1995
Loss = 5.9341e-04, PNorm = 118.9428, GNorm = 0.0139, lr_0 = 9.0137e-04
Validation auc = 0.757927
Epoch 1996
Validation auc = 0.757954
Epoch 1997
Validation auc = 0.757626
Epoch 1998
Validation auc = 0.757626
Epoch 1999
Loss = 5.7768e-05, PNorm = 118.9550, GNorm = 0.0001, lr_0 = 9.0114e-04
Validation auc = 0.757900
Model 0 best validation auc = 0.823256 on epoch 623
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.638760
Ensemble test auc = 0.638760
Fold 4
Splitting data with seed 4
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.480046
Epoch 1
Validation auc = 0.650448
Epoch 2
Validation auc = 0.543680
Epoch 3
Validation auc = 0.653947
Epoch 4
Loss = 7.1468e-01, PNorm = 71.6144, GNorm = 1.4600, lr_0 = 2.0385e-04
Loss = 6.6425e-01, PNorm = 71.6157, GNorm = 2.2937, lr_0 = 2.1077e-04
Validation auc = 0.571561
Epoch 5
Validation auc = 0.621255
Epoch 6
Validation auc = 0.584026
Epoch 7
Validation auc = 0.718183
Epoch 8
Validation auc = 0.719331
Epoch 9
Loss = 7.0061e-01, PNorm = 71.6379, GNorm = 1.0325, lr_0 = 3.0077e-04
Validation auc = 0.717581
Epoch 10
Validation auc = 0.672480
Epoch 11
Validation auc = 0.657610
Epoch 12
Validation auc = 0.662475
Epoch 13
Validation auc = 0.511808
Epoch 14
Loss = 7.5476e-01, PNorm = 71.6835, GNorm = 2.9299, lr_0 = 4.0462e-04
Validation auc = 0.666138
Epoch 15
Validation auc = 0.628854
Epoch 16
Validation auc = 0.674503
Epoch 17
Validation auc = 0.655095
Epoch 18
Loss = 6.8796e-01, PNorm = 71.7361, GNorm = 0.4381, lr_0 = 4.9462e-04
Loss = 6.2899e-01, PNorm = 71.7412, GNorm = 1.6316, lr_0 = 5.0154e-04
Validation auc = 0.670293
Epoch 19
Validation auc = 0.644653
Epoch 20
Validation auc = 0.649902
Epoch 21
Validation auc = 0.603980
Epoch 22
Validation auc = 0.632626
Epoch 23
Loss = 6.4223e-01, PNorm = 71.8239, GNorm = 0.4618, lr_0 = 5.9846e-04
Loss = 7.1002e-01, PNorm = 71.8305, GNorm = 1.9333, lr_0 = 6.0538e-04
Validation auc = 0.608025
Epoch 24
Validation auc = 0.608845
Epoch 25
Validation auc = 0.596108
Epoch 26
Validation auc = 0.594140
Epoch 27
Validation auc = 0.595288
Epoch 28
Loss = 6.7257e-01, PNorm = 71.9237, GNorm = 0.3412, lr_0 = 6.9538e-04
Validation auc = 0.565712
Epoch 29
Validation auc = 0.599934
Epoch 30
Validation auc = 0.605401
Epoch 31
Validation auc = 0.619834
Epoch 32
Validation auc = 0.620162
Epoch 33
Loss = 6.0966e-01, PNorm = 72.0433, GNorm = 0.8055, lr_0 = 7.9923e-04
Validation auc = 0.632736
Epoch 34
Validation auc = 0.632189
Epoch 35
Validation auc = 0.623715
Epoch 36
Validation auc = 0.616444
Epoch 37
Loss = 6.8672e-01, PNorm = 72.1607, GNorm = 1.3508, lr_0 = 8.8923e-04
Loss = 4.8046e-01, PNorm = 72.1720, GNorm = 1.0733, lr_0 = 8.9615e-04
Validation auc = 0.586158
Epoch 38
Validation auc = 0.580472
Epoch 39
Validation auc = 0.597037
Epoch 40
Validation auc = 0.603105
Epoch 41
Validation auc = 0.596654
Epoch 42
Loss = 6.3112e-01, PNorm = 72.3233, GNorm = 0.6695, lr_0 = 9.8615e-04
Validation auc = 0.586869
Epoch 43
Validation auc = 0.558714
Epoch 44
Validation auc = 0.579707
Epoch 45
Validation auc = 0.597748
Epoch 46
Validation auc = 0.612508
Epoch 47
Loss = 6.9487e-01, PNorm = 72.5194, GNorm = 0.6125, lr_0 = 9.9977e-04
Validation auc = 0.615078
Epoch 48
Validation auc = 0.622567
Epoch 49
Validation auc = 0.617100
Epoch 50
Validation auc = 0.578559
Epoch 51
Loss = 5.7692e-01, PNorm = 72.7498, GNorm = 0.8193, lr_0 = 9.9954e-04
Loss = 5.5740e-01, PNorm = 72.7688, GNorm = 1.5601, lr_0 = 9.9952e-04
Validation auc = 0.540728
Epoch 52
Validation auc = 0.520009
Epoch 53
Validation auc = 0.538377
Epoch 54
Validation auc = 0.537721
Epoch 55
Validation auc = 0.550842
Epoch 56
Loss = 6.0056e-01, PNorm = 73.0063, GNorm = 0.3497, lr_0 = 9.9927e-04
Loss = 5.2481e-01, PNorm = 73.0228, GNorm = 0.6428, lr_0 = 9.9926e-04
Validation auc = 0.559862
Epoch 57
Validation auc = 0.569757
Epoch 58
Validation auc = 0.583643
Epoch 59
Validation auc = 0.597912
Epoch 60
Validation auc = 0.561065
Epoch 61
Loss = 4.7504e-01, PNorm = 73.2387, GNorm = 0.5012, lr_0 = 9.9903e-04
Validation auc = 0.527006
Epoch 62
Validation auc = 0.544500
Epoch 63
Validation auc = 0.556855
Epoch 64
Validation auc = 0.566586
Epoch 65
Validation auc = 0.582714
Epoch 66
Loss = 6.3256e-01, PNorm = 73.5655, GNorm = 0.9004, lr_0 = 9.9876e-04
Validation auc = 0.594140
Epoch 67
Validation auc = 0.608463
Epoch 68
Validation auc = 0.612563
Epoch 69
Validation auc = 0.599934
Epoch 70
Loss = 5.6415e-01, PNorm = 73.8722, GNorm = 0.5424, lr_0 = 9.9853e-04
Loss = 4.3414e-01, PNorm = 73.8982, GNorm = 0.9295, lr_0 = 9.9851e-04
Validation auc = 0.561284
Epoch 71
Validation auc = 0.569265
Epoch 72
Validation auc = 0.590477
Epoch 73
Validation auc = 0.573147
Epoch 74
Validation auc = 0.568391
Epoch 75
Loss = 6.1250e-01, PNorm = 74.2079, GNorm = 4.2084, lr_0 = 9.9828e-04
Validation auc = 0.576700
Epoch 76
Validation auc = 0.592445
Epoch 77
Validation auc = 0.571999
Epoch 78
Validation auc = 0.590805
Epoch 79
Validation auc = 0.618084
Epoch 80
Loss = 5.2345e-01, PNorm = 74.4944, GNorm = 1.1749, lr_0 = 9.9802e-04
Validation auc = 0.616171
Epoch 81
Validation auc = 0.618740
Epoch 82
Validation auc = 0.610485
Epoch 83
Validation auc = 0.573967
Epoch 84
Loss = 5.4023e-01, PNorm = 74.7961, GNorm = 2.0959, lr_0 = 9.9779e-04
Loss = 5.3693e-01, PNorm = 74.8224, GNorm = 5.2985, lr_0 = 9.9777e-04
Validation auc = 0.464520
Epoch 85
Validation auc = 0.568227
Epoch 86
Validation auc = 0.583971
Epoch 87
Validation auc = 0.596381
Epoch 88
Validation auc = 0.603324
Epoch 89
Loss = 4.5605e-01, PNorm = 75.2325, GNorm = 1.0724, lr_0 = 9.9752e-04
Loss = 3.8562e-01, PNorm = 75.2606, GNorm = 1.4404, lr_0 = 9.9750e-04
Validation auc = 0.607697
Epoch 90
Validation auc = 0.620052
Epoch 91
Validation auc = 0.618686
Epoch 92
Validation auc = 0.593757
Epoch 93
Validation auc = 0.601738
Epoch 94
Loss = 3.5669e-01, PNorm = 75.6144, GNorm = 0.5891, lr_0 = 9.9727e-04
Validation auc = 0.604253
Epoch 95
Validation auc = 0.606713
Epoch 96
Validation auc = 0.615242
Epoch 97
Validation auc = 0.607041
Epoch 98
Validation auc = 0.601356
Epoch 99
Loss = 6.9248e-01, PNorm = 76.0006, GNorm = 1.4583, lr_0 = 9.9701e-04
Validation auc = 0.575771
Epoch 100
Validation auc = 0.587798
Epoch 101
Validation auc = 0.586759
Epoch 102
Validation auc = 0.572108
Epoch 103
Loss = 4.7161e-01, PNorm = 76.3501, GNorm = 0.5293, lr_0 = 9.9678e-04
Loss = 3.8596e-01, PNorm = 76.3763, GNorm = 1.0765, lr_0 = 9.9676e-04
Validation auc = 0.565766
Epoch 104
Validation auc = 0.566477
Epoch 105
Validation auc = 0.556637
Epoch 106
Validation auc = 0.551006
Epoch 107
Validation auc = 0.568445
Epoch 108
Loss = 3.3055e-01, PNorm = 76.7211, GNorm = 1.6755, lr_0 = 9.9651e-04
Validation auc = 0.571397
Epoch 109
Validation auc = 0.563525
Epoch 110
Validation auc = 0.573311
Epoch 111
Validation auc = 0.573693
Epoch 112
Validation auc = 0.577684
Epoch 113
Loss = 3.8079e-01, PNorm = 77.0705, GNorm = 1.5552, lr_0 = 9.9627e-04
Validation auc = 0.578832
Epoch 114
Validation auc = 0.608353
Epoch 115
Validation auc = 0.622622
Epoch 116
Validation auc = 0.599606
Epoch 117
Loss = 3.1076e-01, PNorm = 77.4082, GNorm = 1.5488, lr_0 = 9.9604e-04
Loss = 2.0884e-01, PNorm = 77.4421, GNorm = 3.6254, lr_0 = 9.9602e-04
Validation auc = 0.552318
Epoch 118
Validation auc = 0.547343
Epoch 119
Validation auc = 0.557730
Epoch 120
Validation auc = 0.541220
Epoch 121
Validation auc = 0.535644
Epoch 122
Loss = 4.2293e-01, PNorm = 77.8701, GNorm = 1.0471, lr_0 = 9.9577e-04
Loss = 4.5687e-01, PNorm = 77.8987, GNorm = 2.2471, lr_0 = 9.9575e-04
Validation auc = 0.522195
Epoch 123
Validation auc = 0.531981
Epoch 124
Validation auc = 0.568336
Epoch 125
Validation auc = 0.596928
Epoch 126
Validation auc = 0.588181
Epoch 127
Loss = 2.5037e-01, PNorm = 78.3003, GNorm = 2.8604, lr_0 = 9.9552e-04
Validation auc = 0.603433
Epoch 128
Validation auc = 0.598732
Epoch 129
Validation auc = 0.595452
Epoch 130
Validation auc = 0.586759
Epoch 131
Validation auc = 0.583479
Epoch 132
Loss = 1.3134e-01, PNorm = 78.6372, GNorm = 0.6666, lr_0 = 9.9526e-04
Validation auc = 0.585502
Epoch 133
Validation auc = 0.572327
Epoch 134
Validation auc = 0.572873
Epoch 135
Validation auc = 0.582222
Epoch 136
Loss = 2.1207e-01, PNorm = 78.9394, GNorm = 0.6612, lr_0 = 9.9503e-04
Loss = 3.2489e-01, PNorm = 78.9626, GNorm = 3.8523, lr_0 = 9.9501e-04
Validation auc = 0.585010
Epoch 137
Validation auc = 0.573748
Epoch 138
Validation auc = 0.567024
Epoch 139
Validation auc = 0.555106
Epoch 140
Validation auc = 0.539416
Epoch 141
Loss = 2.0929e-01, PNorm = 79.2862, GNorm = 1.6587, lr_0 = 9.9477e-04
Validation auc = 0.542204
Epoch 142
Validation auc = 0.535261
Epoch 143
Validation auc = 0.547890
Epoch 144
Validation auc = 0.544938
Epoch 145
Validation auc = 0.556637
Epoch 146
Loss = 9.3048e-02, PNorm = 79.5609, GNorm = 0.6916, lr_0 = 9.9452e-04
Validation auc = 0.569375
Epoch 147
Validation auc = 0.581238
Epoch 148
Validation auc = 0.580363
Epoch 149
Validation auc = 0.564345
Epoch 150
Loss = 1.5118e-01, PNorm = 79.8423, GNorm = 4.2964, lr_0 = 9.9429e-04
Loss = 7.8425e-02, PNorm = 79.8640, GNorm = 2.6410, lr_0 = 9.9427e-04
Validation auc = 0.554231
Epoch 151
Validation auc = 0.556637
Epoch 152
Validation auc = 0.557019
Epoch 153
Validation auc = 0.556309
Epoch 154
Validation auc = 0.550295
Epoch 155
Loss = 1.3991e-01, PNorm = 80.1619, GNorm = 0.5832, lr_0 = 9.9403e-04
Loss = 3.6508e-02, PNorm = 80.1841, GNorm = 1.0033, lr_0 = 9.9401e-04
Validation auc = 0.545320
Epoch 156
Validation auc = 0.562760
Epoch 157
Validation auc = 0.568117
Epoch 158
Validation auc = 0.570413
Epoch 159
Validation auc = 0.573748
Epoch 160
Loss = 1.5661e-01, PNorm = 80.3948, GNorm = 0.9952, lr_0 = 9.9378e-04
Validation auc = 0.576044
Epoch 161
Validation auc = 0.586814
Epoch 162
Validation auc = 0.587689
Epoch 163
Validation auc = 0.573037
Epoch 164
Validation auc = 0.520993
Epoch 165
Loss = 1.6820e-01, PNorm = 80.6161, GNorm = 2.2024, lr_0 = 9.9351e-04
Validation auc = 0.507380
Epoch 166
Validation auc = 0.517986
Epoch 167
Validation auc = 0.527717
Epoch 168
Validation auc = 0.539307
Epoch 169
Loss = 1.4626e-01, PNorm = 80.8699, GNorm = 1.6637, lr_0 = 9.9329e-04
Loss = 1.6413e-01, PNorm = 80.8883, GNorm = 4.5186, lr_0 = 9.9327e-04
Validation auc = 0.541002
Epoch 170
Validation auc = 0.527061
Epoch 171
Validation auc = 0.518861
Epoch 172
Validation auc = 0.534605
Epoch 173
Validation auc = 0.526186
Epoch 174
Loss = 7.4937e-02, PNorm = 81.1443, GNorm = 0.4069, lr_0 = 9.9302e-04
Validation auc = 0.512847
Epoch 175
Validation auc = 0.503881
Epoch 176
Validation auc = 0.495298
Epoch 177
Validation auc = 0.499125
Epoch 178
Validation auc = 0.497704
Epoch 179
Loss = 2.4174e-01, PNorm = 81.3825, GNorm = 4.6651, lr_0 = 9.9277e-04
Validation auc = 0.526514
Epoch 180
Validation auc = 0.541056
Epoch 181
Validation auc = 0.550131
Epoch 182
Validation auc = 0.556473
Epoch 183
Loss = 1.2349e-01, PNorm = 81.5750, GNorm = 0.2498, lr_0 = 9.9253e-04
Validation auc = 0.572163
Epoch 184
Validation auc = 0.582604
Epoch 185
Validation auc = 0.582932
Epoch 186
Validation auc = 0.583698
Epoch 187
Validation auc = 0.584518
Epoch 188
Loss = 9.4408e-02, PNorm = 81.7523, GNorm = 1.4009, lr_0 = 9.9228e-04
Loss = 1.0516e-02, PNorm = 81.7624, GNorm = 0.2123, lr_0 = 9.9226e-04
Validation auc = 0.586978
Epoch 189
Validation auc = 0.586705
Epoch 190
Validation auc = 0.578832
Epoch 191
Validation auc = 0.576099
Epoch 192
Validation auc = 0.585174
Epoch 193
Loss = 4.1090e-02, PNorm = 81.8951, GNorm = 2.2833, lr_0 = 9.9204e-04
Validation auc = 0.607533
Epoch 194
Validation auc = 0.605401
Epoch 195
Validation auc = 0.619998
Epoch 196
Validation auc = 0.631260
Epoch 197
Validation auc = 0.643341
Epoch 198
Loss = 1.3987e-01, PNorm = 82.2039, GNorm = 2.6880, lr_0 = 9.9177e-04
Validation auc = 0.634704
Epoch 199
Validation auc = 0.601957
Epoch 200
Validation auc = 0.566094
Epoch 201
Validation auc = 0.555762
Epoch 202
Loss = 1.3260e-01, PNorm = 82.4506, GNorm = 1.0019, lr_0 = 9.9154e-04
Loss = 1.1622e-02, PNorm = 82.4688, GNorm = 0.2642, lr_0 = 9.9153e-04
Validation auc = 0.562978
Epoch 203
Validation auc = 0.570632
Epoch 204
Validation auc = 0.574295
Epoch 205
Validation auc = 0.569265
Epoch 206
Validation auc = 0.578012
Epoch 207
Loss = 3.2542e-02, PNorm = 82.6732, GNorm = 2.3213, lr_0 = 9.9128e-04
Loss = 5.5136e-03, PNorm = 82.6842, GNorm = 0.1756, lr_0 = 9.9126e-04
Validation auc = 0.584244
Epoch 208
Validation auc = 0.588563
Epoch 209
Validation auc = 0.585994
Epoch 210
Validation auc = 0.573475
Epoch 211
Validation auc = 0.557894
Epoch 212
Loss = 2.8257e-01, PNorm = 82.8276, GNorm = 3.7586, lr_0 = 9.9103e-04
Validation auc = 0.534113
Epoch 213
Validation auc = 0.565548
Epoch 214
Validation auc = 0.586814
Epoch 215
Validation auc = 0.597966
Epoch 216
Loss = 5.2406e-02, PNorm = 83.1036, GNorm = 0.3087, lr_0 = 9.9079e-04
Validation auc = 0.612016
Epoch 217
Validation auc = 0.622294
Epoch 218
Validation auc = 0.631970
Epoch 219
Validation auc = 0.609939
Epoch 220
Validation auc = 0.606768
Epoch 221
Loss = 1.0984e-01, PNorm = 83.2951, GNorm = 0.5321, lr_0 = 9.9054e-04
Loss = 1.8372e-01, PNorm = 83.3082, GNorm = 5.9600, lr_0 = 9.9052e-04
Validation auc = 0.606495
Epoch 222
Validation auc = 0.605237
Epoch 223
Validation auc = 0.605237
Epoch 224
Validation auc = 0.603543
Epoch 225
Validation auc = 0.607205
Epoch 226
Loss = 3.5361e-02, PNorm = 83.5105, GNorm = 0.8396, lr_0 = 9.9030e-04
Validation auc = 0.605073
Epoch 227
Validation auc = 0.599716
Epoch 228
Validation auc = 0.594632
Epoch 229
Validation auc = 0.599278
Epoch 230
Validation auc = 0.595944
Epoch 231
Loss = 3.6624e-02, PNorm = 83.7213, GNorm = 0.4868, lr_0 = 9.9003e-04
Validation auc = 0.590695
Epoch 232
Validation auc = 0.593812
Epoch 233
Validation auc = 0.594960
Epoch 234
Validation auc = 0.583752
Epoch 235
Loss = 1.0900e-01, PNorm = 84.0205, GNorm = 0.3634, lr_0 = 9.8980e-04
Loss = 6.4979e-02, PNorm = 84.0489, GNorm = 1.4193, lr_0 = 9.8979e-04
Validation auc = 0.588071
Epoch 236
Validation auc = 0.582112
Epoch 237
Validation auc = 0.579980
Epoch 238
Validation auc = 0.575279
Epoch 239
Validation auc = 0.562541
Epoch 240
Loss = 1.0491e-01, PNorm = 84.3491, GNorm = 0.4368, lr_0 = 9.8954e-04
Loss = 5.1009e-01, PNorm = 84.3638, GNorm = 9.2689, lr_0 = 9.8952e-04
Validation auc = 0.556965
Epoch 241
Validation auc = 0.559698
Epoch 242
Validation auc = 0.564728
Epoch 243
Validation auc = 0.568008
Epoch 244
Validation auc = 0.571507
Epoch 245
Loss = 2.2528e-01, PNorm = 84.5644, GNorm = 0.9762, lr_0 = 9.8930e-04
Validation auc = 0.575825
Epoch 246
Validation auc = 0.588181
Epoch 247
Validation auc = 0.599278
Epoch 248
Validation auc = 0.600481
Epoch 249
Loss = 2.9061e-01, PNorm = 84.7294, GNorm = 7.8152, lr_0 = 9.8905e-04
Validation auc = 0.594030
Epoch 250
Validation auc = 0.583534
Epoch 251
Validation auc = 0.572108
Epoch 252
Validation auc = 0.561338
Epoch 253
Validation auc = 0.555215
Epoch 254
Loss = 1.0515e-01, PNorm = 84.8882, GNorm = 1.2154, lr_0 = 9.8880e-04
Loss = 4.0611e-03, PNorm = 84.8961, GNorm = 0.1370, lr_0 = 9.8879e-04
Validation auc = 0.553521
Epoch 255
Validation auc = 0.552755
Epoch 256
Validation auc = 0.556637
Epoch 257
Validation auc = 0.563033
Epoch 258
Validation auc = 0.558605
Epoch 259
Loss = 2.0836e-02, PNorm = 85.0212, GNorm = 0.4124, lr_0 = 9.8856e-04
Validation auc = 0.556801
Epoch 260
Validation auc = 0.555106
Epoch 261
Validation auc = 0.553083
Epoch 262
Validation auc = 0.548874
Epoch 263
Validation auc = 0.542368
Epoch 264
Loss = 2.5043e-02, PNorm = 85.1349, GNorm = 0.8074, lr_0 = 9.8830e-04
Validation auc = 0.536191
Epoch 265
Validation auc = 0.535589
Epoch 266
Validation auc = 0.545375
Epoch 267
Validation auc = 0.544774
Epoch 268
Loss = 5.2996e-02, PNorm = 85.2587, GNorm = 0.4390, lr_0 = 9.8807e-04
Loss = 9.5521e-03, PNorm = 85.2708, GNorm = 0.1472, lr_0 = 9.8805e-04
Validation auc = 0.540072
Epoch 269
Validation auc = 0.538541
Epoch 270
Validation auc = 0.551553
Epoch 271
Validation auc = 0.565384
Epoch 272
Validation auc = 0.565821
Epoch 273
Loss = 1.4960e-01, PNorm = 85.3956, GNorm = 1.5691, lr_0 = 9.8781e-04
Loss = 1.1931e-02, PNorm = 85.4034, GNorm = 0.3115, lr_0 = 9.8779e-04
Validation auc = 0.559042
Epoch 274
Validation auc = 0.562869
Epoch 275
Validation auc = 0.575552
Epoch 276
Validation auc = 0.580090
Epoch 277
Validation auc = 0.585502
Epoch 278
Loss = 9.1761e-03, PNorm = 85.5161, GNorm = 0.0979, lr_0 = 9.8756e-04
Validation auc = 0.589438
Epoch 279
Validation auc = 0.591406
Epoch 280
Validation auc = 0.594304
Epoch 281
Validation auc = 0.584463
Epoch 282
Validation auc = 0.563744
Epoch 283
Loss = 2.5927e-02, PNorm = 85.6202, GNorm = 0.5814, lr_0 = 9.8730e-04
Validation auc = 0.545102
Epoch 284
Validation auc = 0.533949
Epoch 285
Validation auc = 0.529849
Epoch 286
Validation auc = 0.526350
Epoch 287
Loss = 3.6660e-03, PNorm = 85.7002, GNorm = 0.0673, lr_0 = 9.8707e-04
Loss = 1.0537e-03, PNorm = 85.7061, GNorm = 0.0384, lr_0 = 9.8705e-04
Validation auc = 0.526460
Epoch 288
Validation auc = 0.527936
Epoch 289
Validation auc = 0.528974
Epoch 290
Validation auc = 0.520337
Epoch 291
Validation auc = 0.534605
Epoch 292
Loss = 1.2109e-01, PNorm = 85.7600, GNorm = 0.6442, lr_0 = 9.8683e-04
Validation auc = 0.539963
Epoch 293
Validation auc = 0.546250
Epoch 294
Validation auc = 0.550842
Epoch 295
Validation auc = 0.554122
Epoch 296
Validation auc = 0.559480
Epoch 297
Loss = 2.8836e-03, PNorm = 85.8049, GNorm = 0.0842, lr_0 = 9.8656e-04
Validation auc = 0.548272
Epoch 298
Validation auc = 0.528756
Epoch 299
Validation auc = 0.512082
Epoch 300
Validation auc = 0.572163
Epoch 301
Loss = 7.2525e-01, PNorm = 85.9936, GNorm = 1.4230, lr_0 = 9.8634e-04
Loss = 2.5994e-01, PNorm = 86.0218, GNorm = 3.4091, lr_0 = 9.8632e-04
Validation auc = 0.537065
Epoch 302
Validation auc = 0.532747
Epoch 303
Validation auc = 0.532692
Epoch 304
Validation auc = 0.528974
Epoch 305
Validation auc = 0.538268
Epoch 306
Loss = 5.2300e-02, PNorm = 86.4242, GNorm = 0.7096, lr_0 = 9.8607e-04
Loss = 2.7295e-01, PNorm = 86.4471, GNorm = 4.9226, lr_0 = 9.8606e-04
Validation auc = 0.539744
Epoch 307
Validation auc = 0.547616
Epoch 308
Validation auc = 0.553521
Epoch 309
Validation auc = 0.540564
Epoch 310
Validation auc = 0.526733
Epoch 311
Loss = 1.2706e-01, PNorm = 86.6780, GNorm = 0.8522, lr_0 = 9.8583e-04
Validation auc = 0.521047
Epoch 312
Validation auc = 0.519626
Epoch 313
Validation auc = 0.527662
Epoch 314
Validation auc = 0.534933
Epoch 315
Validation auc = 0.542751
Epoch 316
Loss = 2.9531e-02, PNorm = 86.8246, GNorm = 0.4017, lr_0 = 9.8557e-04
Validation auc = 0.547890
Epoch 317
Validation auc = 0.539252
Epoch 318
Validation auc = 0.515198
Epoch 319
Validation auc = 0.509840
Epoch 320
Loss = 1.0157e-01, PNorm = 86.9546, GNorm = 0.4423, lr_0 = 9.8534e-04
Loss = 1.6970e-02, PNorm = 86.9674, GNorm = 0.2504, lr_0 = 9.8532e-04
Validation auc = 0.509348
Epoch 321
Validation auc = 0.509512
Epoch 322
Validation auc = 0.525968
Epoch 323
Validation auc = 0.530778
Epoch 324
Validation auc = 0.522141
Epoch 325
Loss = 1.5915e-01, PNorm = 87.1868, GNorm = 0.6722, lr_0 = 9.8509e-04
Validation auc = 0.514487
Epoch 326
Validation auc = 0.503007
Epoch 327
Validation auc = 0.485403
Epoch 328
Validation auc = 0.473923
Epoch 329
Validation auc = 0.472611
Epoch 330
Loss = 7.2078e-02, PNorm = 87.5039, GNorm = 0.5691, lr_0 = 9.8483e-04
Validation auc = 0.479281
Epoch 331
Validation auc = 0.483107
Epoch 332
Validation auc = 0.499180
Epoch 333
Validation auc = 0.516182
Epoch 334
Loss = 2.9944e-02, PNorm = 87.7426, GNorm = 1.3091, lr_0 = 9.8461e-04
Loss = 2.7641e-02, PNorm = 87.7573, GNorm = 0.9320, lr_0 = 9.8459e-04
Validation auc = 0.530833
Epoch 335
Validation auc = 0.539225
Epoch 336
Validation auc = 0.544227
Epoch 337
Validation auc = 0.540072
Epoch 338
Validation auc = 0.526460
Epoch 339
Loss = 1.6636e-02, PNorm = 87.9149, GNorm = 0.4083, lr_0 = 9.8434e-04
Loss = 4.4618e-03, PNorm = 87.9254, GNorm = 0.0913, lr_0 = 9.8433e-04
Validation auc = 0.520063
Epoch 340
Validation auc = 0.516510
Epoch 341
Validation auc = 0.516346
Epoch 342
Validation auc = 0.516619
Epoch 343
Validation auc = 0.514979
Epoch 344
Loss = 6.6172e-03, PNorm = 88.0317, GNorm = 0.0903, lr_0 = 9.8410e-04
Validation auc = 0.510551
Epoch 345
Validation auc = 0.501257
Epoch 346
Validation auc = 0.499399
Epoch 347
Validation auc = 0.499781
Epoch 348
Validation auc = 0.532036
Epoch 349
Loss = 2.1417e-02, PNorm = 88.1010, GNorm = 1.4060, lr_0 = 9.8384e-04
Validation auc = 0.556473
Epoch 350
Validation auc = 0.570468
Epoch 351
Validation auc = 0.579106
Epoch 352
Validation auc = 0.588563
Epoch 353
Loss = 6.5330e-02, PNorm = 88.2286, GNorm = 0.6965, lr_0 = 9.8361e-04
Loss = 1.1481e+00, PNorm = 88.2342, GNorm = 5.3790, lr_0 = 9.8359e-04
Validation auc = 0.590641
Epoch 354
Validation auc = 0.585010
Epoch 355
Validation auc = 0.572381
Epoch 356
Validation auc = 0.572873
Epoch 357
Validation auc = 0.584682
Epoch 358
Loss = 6.0692e-02, PNorm = 88.4050, GNorm = 1.4341, lr_0 = 9.8335e-04
Validation auc = 0.604581
Epoch 359
Validation auc = 0.607807
Epoch 360
Validation auc = 0.613438
Epoch 361
Validation auc = 0.611688
Epoch 362
Validation auc = 0.609665
Epoch 363
Loss = 1.5161e-01, PNorm = 88.5889, GNorm = 0.7775, lr_0 = 9.8311e-04
Validation auc = 0.611524
Epoch 364
Validation auc = 0.613000
Epoch 365
Validation auc = 0.610649
Epoch 366
Validation auc = 0.605292
Epoch 367
Loss = 8.0542e-02, PNorm = 88.7831, GNorm = 0.9808, lr_0 = 9.8288e-04
Loss = 3.1904e-02, PNorm = 88.7987, GNorm = 0.5649, lr_0 = 9.8286e-04
Validation auc = 0.604472
Epoch 368
Validation auc = 0.603652
Epoch 369
Validation auc = 0.603707
Epoch 370
Validation auc = 0.602558
Epoch 371
Validation auc = 0.599770
Epoch 372
Loss = 1.4626e-02, PNorm = 88.9588, GNorm = 1.6710, lr_0 = 9.8262e-04
Loss = 2.0362e-03, PNorm = 88.9665, GNorm = 0.0450, lr_0 = 9.8260e-04
Validation auc = 0.598076
Epoch 373
Validation auc = 0.599442
Epoch 374
Validation auc = 0.611469
Epoch 375
Validation auc = 0.609884
Epoch 376
Validation auc = 0.601028
Epoch 377
Loss = 7.6763e-01, PNorm = 89.1707, GNorm = 7.1331, lr_0 = 9.8237e-04
Validation auc = 0.605183
Epoch 378
Validation auc = 0.599224
Epoch 379
Validation auc = 0.587689
Epoch 380
Validation auc = 0.582167
Epoch 381
Validation auc = 0.592390
Epoch 382
Loss = 1.9601e-01, PNorm = 89.6787, GNorm = 1.0977, lr_0 = 9.8211e-04
Validation auc = 0.608681
Epoch 383
Validation auc = 0.607424
Epoch 384
Validation auc = 0.611087
Epoch 385
Validation auc = 0.595342
Epoch 386
Loss = 8.6418e-02, PNorm = 89.9740, GNorm = 0.6133, lr_0 = 9.8189e-04
Loss = 3.4655e-01, PNorm = 89.9901, GNorm = 4.8511, lr_0 = 9.8187e-04
Validation auc = 0.580363
Epoch 387
Validation auc = 0.574841
Epoch 388
Validation auc = 0.567188
Epoch 389
Validation auc = 0.558496
Epoch 390
Validation auc = 0.552865
Epoch 391
Loss = 7.7314e-02, PNorm = 90.1836, GNorm = 0.2308, lr_0 = 9.8163e-04
Validation auc = 0.558496
Epoch 392
Validation auc = 0.576700
Epoch 393
Validation auc = 0.589055
Epoch 394
Validation auc = 0.590859
Epoch 395
Validation auc = 0.586267
Epoch 396
Loss = 1.4649e-01, PNorm = 90.3318, GNorm = 0.8636, lr_0 = 9.8138e-04
Validation auc = 0.586705
Epoch 397
Validation auc = 0.592171
Epoch 398
Validation auc = 0.595725
Epoch 399
Validation auc = 0.598349
Epoch 400
Loss = 6.0975e-02, PNorm = 90.4199, GNorm = 0.6398, lr_0 = 9.8116e-04
Loss = 1.4641e-02, PNorm = 90.4281, GNorm = 0.2244, lr_0 = 9.8114e-04
Validation auc = 0.599333
Epoch 401
Validation auc = 0.599880
Epoch 402
Validation auc = 0.599278
Epoch 403
Validation auc = 0.599606
Epoch 404
Validation auc = 0.600262
Epoch 405
Loss = 6.2994e-02, PNorm = 90.5354, GNorm = 0.0950, lr_0 = 9.8089e-04
Loss = 6.3564e-03, PNorm = 90.5408, GNorm = 0.1533, lr_0 = 9.8088e-04
Validation auc = 0.601520
Epoch 406
Validation auc = 0.602668
Epoch 407
Validation auc = 0.601684
Epoch 408
Validation auc = 0.607697
Epoch 409
Validation auc = 0.610212
Epoch 410
Loss = 8.0910e-03, PNorm = 90.5767, GNorm = 0.2102, lr_0 = 9.8065e-04
Validation auc = 0.612290
Epoch 411
Validation auc = 0.612290
Epoch 412
Validation auc = 0.611798
Epoch 413
Validation auc = 0.611087
Epoch 414
Validation auc = 0.610267
Epoch 415
Loss = 2.4809e-02, PNorm = 90.6229, GNorm = 0.4903, lr_0 = 9.8039e-04
Validation auc = 0.610485
Epoch 416
Validation auc = 0.612946
Epoch 417
Validation auc = 0.619396
Epoch 418
Validation auc = 0.619287
Epoch 419
Loss = 4.3192e-02, PNorm = 90.6594, GNorm = 2.1672, lr_0 = 9.8016e-04
Loss = 2.7818e-04, PNorm = 90.6621, GNorm = 0.0066, lr_0 = 9.8015e-04
Validation auc = 0.618303
Epoch 420
Validation auc = 0.616007
Epoch 421
Validation auc = 0.610376
Epoch 422
Validation auc = 0.606877
Epoch 423
Validation auc = 0.602723
Epoch 424
Loss = 6.0508e-02, PNorm = 90.7228, GNorm = 0.0494, lr_0 = 9.7990e-04
Validation auc = 0.596326
Epoch 425
Validation auc = 0.590203
Epoch 426
Validation auc = 0.578996
Epoch 427
Validation auc = 0.591023
Epoch 428
Validation auc = 0.599497
Epoch 429
Loss = 3.7532e-02, PNorm = 90.8049, GNorm = 0.5271, lr_0 = 9.7966e-04
Validation auc = 0.600700
Epoch 430
Validation auc = 0.600864
Epoch 431
Validation auc = 0.600481
Epoch 432
Validation auc = 0.598294
Epoch 433
Loss = 1.4105e-02, PNorm = 90.9163, GNorm = 0.1962, lr_0 = 9.7942e-04
Validation auc = 0.594413
Epoch 434
Validation auc = 0.593866
Epoch 435
Validation auc = 0.590969
Epoch 436
Validation auc = 0.589821
Epoch 437
Validation auc = 0.588891
Epoch 438
Loss = 9.1127e-03, PNorm = 90.9996, GNorm = 0.1363, lr_0 = 9.7917e-04
Loss = 1.9762e-03, PNorm = 91.0057, GNorm = 0.0441, lr_0 = 9.7916e-04
Validation auc = 0.587415
Epoch 439
Validation auc = 0.587579
Epoch 440
Validation auc = 0.587251
Epoch 441
Validation auc = 0.586923
Epoch 442
Validation auc = 0.587525
Epoch 443
Loss = 3.1390e-03, PNorm = 91.0715, GNorm = 0.0608, lr_0 = 9.7893e-04
Validation auc = 0.588837
Epoch 444
Validation auc = 0.593155
Epoch 445
Validation auc = 0.596162
Epoch 446
Validation auc = 0.599333
Epoch 447
Validation auc = 0.602394
Epoch 448
Loss = 1.4016e-03, PNorm = 91.1355, GNorm = 0.0556, lr_0 = 9.7867e-04
Validation auc = 0.603543
Epoch 449
Validation auc = 0.602887
Epoch 450
Validation auc = 0.602723
Epoch 451
Validation auc = 0.599169
Epoch 452
Loss = 4.3030e-02, PNorm = 91.1752, GNorm = 1.5891, lr_0 = 9.7845e-04
Loss = 6.3636e-03, PNorm = 91.1784, GNorm = 0.4316, lr_0 = 9.7843e-04
Validation auc = 0.593265
Epoch 453
Validation auc = 0.586705
Epoch 454
Validation auc = 0.580964
Epoch 455
Validation auc = 0.582714
Epoch 456
Validation auc = 0.584901
Epoch 457
Loss = 1.3543e-03, PNorm = 91.2201, GNorm = 0.0298, lr_0 = 9.7819e-04
Loss = 3.5784e-04, PNorm = 91.2230, GNorm = 0.0101, lr_0 = 9.7817e-04
Validation auc = 0.586486
Epoch 458
Validation auc = 0.589001
Epoch 459
Validation auc = 0.589657
Epoch 460
Validation auc = 0.590313
Epoch 461
Validation auc = 0.589547
Epoch 462
Loss = 1.7190e-02, PNorm = 91.2696, GNorm = 0.3868, lr_0 = 9.7794e-04
Validation auc = 0.587197
Epoch 463
Validation auc = 0.585611
Epoch 464
Validation auc = 0.584408
Epoch 465
Validation auc = 0.584408
Epoch 466
Loss = 4.1394e-04, PNorm = 91.3083, GNorm = 0.0021, lr_0 = 9.7770e-04
Validation auc = 0.584299
Epoch 467
Validation auc = 0.584244
Epoch 468
Validation auc = 0.580691
Epoch 469
Validation auc = 0.578832
Epoch 470
Validation auc = 0.576919
Epoch 471
Loss = 3.7695e-03, PNorm = 91.3255, GNorm = 0.0621, lr_0 = 9.7746e-04
Loss = 7.9859e-04, PNorm = 91.3272, GNorm = 0.0273, lr_0 = 9.7744e-04
Validation auc = 0.576372
Epoch 472
Validation auc = 0.576919
Epoch 473
Validation auc = 0.576864
Epoch 474
Validation auc = 0.577466
Epoch 475
Validation auc = 0.576810
Epoch 476
Loss = 8.3343e-04, PNorm = 91.3518, GNorm = 0.0227, lr_0 = 9.7721e-04
Validation auc = 0.576208
Epoch 477
Validation auc = 0.575716
Epoch 478
Validation auc = 0.575443
Epoch 479
Validation auc = 0.575169
Epoch 480
Validation auc = 0.573147
Epoch 481
Loss = 5.3666e-04, PNorm = 91.3710, GNorm = 0.0178, lr_0 = 9.7695e-04
Validation auc = 0.570796
Epoch 482
Validation auc = 0.568555
Epoch 483
Validation auc = 0.566969
Epoch 484
Validation auc = 0.565657
Epoch 485
Loss = 5.6311e-04, PNorm = 91.3842, GNorm = 0.0277, lr_0 = 9.7673e-04
Loss = 1.8948e-04, PNorm = 91.3851, GNorm = 0.0063, lr_0 = 9.7671e-04
Validation auc = 0.564673
Epoch 486
Validation auc = 0.563908
Epoch 487
Validation auc = 0.563580
Epoch 488
Validation auc = 0.563252
Epoch 489
Validation auc = 0.562322
Epoch 490
Loss = 4.9214e-04, PNorm = 91.3997, GNorm = 0.0045, lr_0 = 9.7647e-04
Loss = 1.1784e-03, PNorm = 91.4010, GNorm = 0.0294, lr_0 = 9.7645e-04
Validation auc = 0.561502
Epoch 491
Validation auc = 0.561776
Epoch 492
Validation auc = 0.562158
Epoch 493
Validation auc = 0.562049
Epoch 494
Validation auc = 0.562596
Epoch 495
Loss = 2.6125e-04, PNorm = 91.4125, GNorm = 0.0054, lr_0 = 9.7623e-04
Validation auc = 0.562596
Epoch 496
Validation auc = 0.551771
Epoch 497
Validation auc = 0.541712
Epoch 498
Validation auc = 0.539635
Epoch 499
Loss = 1.4434e-02, PNorm = 91.4113, GNorm = 0.0279, lr_0 = 9.7599e-04
Validation auc = 0.583971
Epoch 500
Validation auc = 0.605292
Epoch 501
Validation auc = 0.615132
Epoch 502
Validation auc = 0.620873
Epoch 503
Validation auc = 0.623770
Epoch 504
Loss = 3.9376e-02, PNorm = 91.4322, GNorm = 0.5967, lr_0 = 9.7574e-04
Loss = 2.9005e-04, PNorm = 91.4336, GNorm = 0.0072, lr_0 = 9.7573e-04
Validation auc = 0.625629
Epoch 505
Validation auc = 0.625847
Epoch 506
Validation auc = 0.632025
Epoch 507
Validation auc = 0.632681
Epoch 508
Validation auc = 0.630385
Epoch 509
Loss = 9.4298e-03, PNorm = 91.4583, GNorm = 0.3595, lr_0 = 9.7550e-04
Validation auc = 0.629510
Epoch 510
Validation auc = 0.628417
Epoch 511
Validation auc = 0.628581
Epoch 512
Validation auc = 0.627815
Epoch 513
Validation auc = 0.627433
Epoch 514
Loss = 6.0399e-04, PNorm = 91.4997, GNorm = 0.0152, lr_0 = 9.7524e-04
Validation auc = 0.626339
Epoch 515
Validation auc = 0.624098
Epoch 516
Validation auc = 0.622950
Epoch 517
Validation auc = 0.622622
Epoch 518
Loss = 3.5451e-02, PNorm = 91.5204, GNorm = 1.3786, lr_0 = 9.7502e-04
Loss = 1.0933e-03, PNorm = 91.5213, GNorm = 0.0300, lr_0 = 9.7500e-04
Validation auc = 0.620490
Epoch 519
Validation auc = 0.619724
Epoch 520
Validation auc = 0.620982
Epoch 521
Validation auc = 0.622239
Epoch 522
Validation auc = 0.623059
Epoch 523
Loss = 5.5894e-04, PNorm = 91.5502, GNorm = 0.0166, lr_0 = 9.7476e-04
Loss = 4.0804e-05, PNorm = 91.5518, GNorm = 0.0017, lr_0 = 9.7474e-04
Validation auc = 0.624043
Epoch 524
Validation auc = 0.624481
Epoch 525
Validation auc = 0.624317
Epoch 526
Validation auc = 0.624371
Epoch 527
Validation auc = 0.626449
Epoch 528
Loss = 1.9265e-04, PNorm = 91.5668, GNorm = 0.0043, lr_0 = 9.7452e-04
Validation auc = 0.627542
Epoch 529
Validation auc = 0.627815
Epoch 530
Validation auc = 0.628143
Epoch 531
Validation auc = 0.628581
Epoch 532
Validation auc = 0.628963
Epoch 533
Loss = 2.0452e-04, PNorm = 91.5774, GNorm = 0.0047, lr_0 = 9.7426e-04
Validation auc = 0.629729
Epoch 534
Validation auc = 0.624590
Epoch 535
Validation auc = 0.616062
Epoch 536
Validation auc = 0.614695
Epoch 537
Loss = 8.5562e-02, PNorm = 91.6148, GNorm = 0.8097, lr_0 = 9.7403e-04
Loss = 1.5484e-03, PNorm = 91.6238, GNorm = 0.0332, lr_0 = 9.7401e-04
Validation auc = 0.618303
Epoch 538
Validation auc = 0.623551
Epoch 539
Validation auc = 0.630057
Epoch 540
Validation auc = 0.636726
Epoch 541
Validation auc = 0.635032
Epoch 542
Loss = 1.0125e-01, PNorm = 91.7420, GNorm = 0.9253, lr_0 = 9.7379e-04
Validation auc = 0.643505
Epoch 543
Validation auc = 0.660179
Epoch 544
Validation auc = 0.667177
Epoch 545
Validation auc = 0.676416
Epoch 546
Validation auc = 0.684015
Epoch 547
Loss = 2.1331e-01, PNorm = 92.1283, GNorm = 1.0214, lr_0 = 9.7353e-04
Validation auc = 0.683359
Epoch 548
Validation auc = 0.669200
Epoch 549
Validation auc = 0.661983
Epoch 550
Validation auc = 0.655806
Epoch 551
Loss = 1.5950e-01, PNorm = 92.3988, GNorm = 0.7667, lr_0 = 9.7331e-04
Loss = 1.3345e-02, PNorm = 92.4138, GNorm = 0.3397, lr_0 = 9.7329e-04
Validation auc = 0.640280
Epoch 552
Validation auc = 0.630002
Epoch 553
Validation auc = 0.618686
Epoch 554
Validation auc = 0.606932
Epoch 555
Validation auc = 0.601192
Epoch 556
Loss = 3.7932e-02, PNorm = 92.5870, GNorm = 0.5838, lr_0 = 9.7305e-04
Loss = 1.5362e-02, PNorm = 92.5970, GNorm = 0.4345, lr_0 = 9.7303e-04
Validation auc = 0.598294
Epoch 557
Validation auc = 0.595670
Epoch 558
Validation auc = 0.592226
Epoch 559
Validation auc = 0.597092
Epoch 560
Validation auc = 0.608189
Epoch 561
Loss = 1.4733e-01, PNorm = 92.7008, GNorm = 0.6905, lr_0 = 9.7281e-04
Validation auc = 0.611251
Epoch 562
Validation auc = 0.613383
Epoch 563
Validation auc = 0.613000
Epoch 564
Validation auc = 0.612235
Epoch 565
Validation auc = 0.609337
Epoch 566
Loss = 1.0218e-02, PNorm = 92.8013, GNorm = 0.2930, lr_0 = 9.7255e-04
Validation auc = 0.603051
Epoch 567
Validation auc = 0.600044
Epoch 568
Validation auc = 0.597310
Epoch 569
Validation auc = 0.596490
Epoch 570
Loss = 1.8561e-02, PNorm = 92.8934, GNorm = 0.6978, lr_0 = 9.7232e-04
Loss = 8.5401e-04, PNorm = 92.8986, GNorm = 0.0288, lr_0 = 9.7231e-04
Validation auc = 0.594686
Epoch 571
Validation auc = 0.592609
Epoch 572
Validation auc = 0.596162
Epoch 573
Validation auc = 0.600208
Epoch 574
Validation auc = 0.603324
Epoch 575
Loss = 5.5169e-04, PNorm = 92.9491, GNorm = 0.0135, lr_0 = 9.7208e-04
Validation auc = 0.606659
Epoch 576
Validation auc = 0.613164
Epoch 577
Validation auc = 0.620435
Epoch 578
Validation auc = 0.623387
Epoch 579
Validation auc = 0.624535
Epoch 580
Loss = 1.2744e-03, PNorm = 92.9892, GNorm = 0.0777, lr_0 = 9.7182e-04
Validation auc = 0.624754
Epoch 581
Validation auc = 0.624481
Epoch 582
Validation auc = 0.622567
Epoch 583
Validation auc = 0.620271
Epoch 584
Loss = 2.4805e-03, PNorm = 93.0105, GNorm = 0.2008, lr_0 = 9.7160e-04
Loss = 1.4512e-04, PNorm = 93.0131, GNorm = 0.0049, lr_0 = 9.7158e-04
Validation auc = 0.616280
Epoch 585
Validation auc = 0.610157
Epoch 586
Validation auc = 0.598021
Epoch 587
Validation auc = 0.590313
Epoch 588
Validation auc = 0.587415
Epoch 589
Loss = 4.1008e-02, PNorm = 93.1150, GNorm = 0.0695, lr_0 = 9.7134e-04
Loss = 3.0361e-03, PNorm = 93.1246, GNorm = 0.0885, lr_0 = 9.7132e-04
Validation auc = 0.584572
Epoch 590
Validation auc = 0.581128
Epoch 591
Validation auc = 0.578832
Epoch 592
Validation auc = 0.571561
Epoch 593
Validation auc = 0.592663
Epoch 594
Loss = 1.4747e-02, PNorm = 93.2850, GNorm = 0.3236, lr_0 = 9.7110e-04
Validation auc = 0.591242
Epoch 595
Validation auc = 0.590313
Epoch 596
Validation auc = 0.593866
Epoch 597
Validation auc = 0.599989
Epoch 598
Validation auc = 0.608353
Epoch 599
Loss = 3.2342e-02, PNorm = 93.5116, GNorm = 0.9162, lr_0 = 9.7084e-04
Validation auc = 0.609337
Epoch 600
Validation auc = 0.607151
Epoch 601
Validation auc = 0.607424
Epoch 602
Validation auc = 0.609447
Epoch 603
Loss = 8.6952e-02, PNorm = 93.6235, GNorm = 1.4210, lr_0 = 9.7062e-04
Loss = 1.1484e-02, PNorm = 93.6301, GNorm = 0.3377, lr_0 = 9.7060e-04
Validation auc = 0.608299
Epoch 604
Validation auc = 0.606495
Epoch 605
Validation auc = 0.604964
Epoch 606
Validation auc = 0.603925
Epoch 607
Validation auc = 0.607096
Epoch 608
Loss = 2.1103e-02, PNorm = 93.7092, GNorm = 1.2831, lr_0 = 9.7036e-04
Validation auc = 0.604800
Epoch 609
Validation auc = 0.589001
Epoch 610
Validation auc = 0.587798
Epoch 611
Validation auc = 0.583315
Epoch 612
Validation auc = 0.581456
Epoch 613
Loss = 6.1094e-02, PNorm = 93.7708, GNorm = 0.4927, lr_0 = 9.7012e-04
Validation auc = 0.581183
Epoch 614
Validation auc = 0.579816
Epoch 615
Validation auc = 0.576864
Epoch 616
Validation auc = 0.578450
Epoch 617
Loss = 3.3548e-02, PNorm = 93.9481, GNorm = 0.9927, lr_0 = 9.6990e-04
Loss = 1.9833e-02, PNorm = 93.9617, GNorm = 0.8120, lr_0 = 9.6988e-04
Validation auc = 0.594030
Epoch 618
Validation auc = 0.596326
Epoch 619
Validation auc = 0.612672
Epoch 620
Validation auc = 0.625465
Epoch 621
Validation auc = 0.635852
Epoch 622
Loss = 2.2027e-01, PNorm = 94.2254, GNorm = 3.2199, lr_0 = 9.6964e-04
Loss = 1.9430e-01, PNorm = 94.2497, GNorm = 4.2938, lr_0 = 9.6962e-04
Validation auc = 0.637820
Epoch 623
Validation auc = 0.633938
Epoch 624
Validation auc = 0.628635
Epoch 625
Validation auc = 0.627378
Epoch 626
Validation auc = 0.632736
Epoch 627
Loss = 6.1742e-02, PNorm = 94.5405, GNorm = 0.3407, lr_0 = 9.6940e-04
Validation auc = 0.634485
Epoch 628
Validation auc = 0.633118
Epoch 629
Validation auc = 0.629565
Epoch 630
Validation auc = 0.631478
Epoch 631
Validation auc = 0.632626
Epoch 632
Loss = 1.5132e-02, PNorm = 94.8110, GNorm = 0.5741, lr_0 = 9.6914e-04
Validation auc = 0.632298
Epoch 633
Validation auc = 0.632572
Epoch 634
Validation auc = 0.634977
Epoch 635
Validation auc = 0.637984
Epoch 636
Loss = 5.9743e-02, PNorm = 94.9171, GNorm = 1.6185, lr_0 = 9.6892e-04
Loss = 5.1201e-04, PNorm = 94.9226, GNorm = 0.0153, lr_0 = 9.6890e-04
Validation auc = 0.634594
Epoch 637
Validation auc = 0.625957
Epoch 638
Validation auc = 0.609447
Epoch 639
Validation auc = 0.588345
Epoch 640
Validation auc = 0.577302
Epoch 641
Loss = 5.2700e-02, PNorm = 95.0683, GNorm = 1.3074, lr_0 = 9.6866e-04
Validation auc = 0.570413
Epoch 642
Validation auc = 0.573147
Epoch 643
Validation auc = 0.584518
Epoch 644
Validation auc = 0.595342
Epoch 645
Validation auc = 0.599224
Epoch 646
Loss = 5.8192e-02, PNorm = 95.2824, GNorm = 0.9146, lr_0 = 9.6842e-04
Validation auc = 0.603980
Epoch 647
Validation auc = 0.606167
Epoch 648
Validation auc = 0.603707
Epoch 649
Validation auc = 0.601082
Epoch 650
Loss = 5.8428e-03, PNorm = 95.4035, GNorm = 0.0998, lr_0 = 9.6820e-04
Loss = 4.7577e-04, PNorm = 95.4096, GNorm = 0.0155, lr_0 = 9.6818e-04
Validation auc = 0.598841
Epoch 651
Validation auc = 0.596818
Epoch 652
Validation auc = 0.594960
Epoch 653
Validation auc = 0.594905
Epoch 654
Validation auc = 0.594468
Epoch 655
Loss = 3.7869e-02, PNorm = 95.4820, GNorm = 0.7784, lr_0 = 9.6794e-04
Loss = 4.5564e-04, PNorm = 95.4856, GNorm = 0.0163, lr_0 = 9.6792e-04
Validation auc = 0.595561
Epoch 656
Validation auc = 0.596654
Epoch 657
Validation auc = 0.595834
Epoch 658
Validation auc = 0.594632
Epoch 659
Validation auc = 0.596162
Epoch 660
Loss = 4.6329e-03, PNorm = 95.5366, GNorm = 0.0917, lr_0 = 9.6770e-04
Validation auc = 0.598950
Epoch 661
Validation auc = 0.600208
Epoch 662
Validation auc = 0.600317
Epoch 663
Validation auc = 0.603707
Epoch 664
Validation auc = 0.602996
Epoch 665
Loss = 3.3553e-03, PNorm = 95.6011, GNorm = 0.0740, lr_0 = 9.6744e-04
Validation auc = 0.602340
Epoch 666
Validation auc = 0.603269
Epoch 667
Validation auc = 0.604581
Epoch 668
Validation auc = 0.609556
Epoch 669
Loss = 3.4081e-03, PNorm = 95.6508, GNorm = 0.0514, lr_0 = 9.6722e-04
Loss = 8.6897e-03, PNorm = 95.6545, GNorm = 0.3054, lr_0 = 9.6720e-04
Validation auc = 0.613274
Epoch 670
Validation auc = 0.615078
Epoch 671
Validation auc = 0.616827
Epoch 672
Validation auc = 0.615460
Epoch 673
Validation auc = 0.614039
Epoch 674
Loss = 7.2820e-04, PNorm = 95.7075, GNorm = 0.0084, lr_0 = 9.6696e-04
Validation auc = 0.612836
Epoch 675
Validation auc = 0.612618
Epoch 676
Validation auc = 0.611798
Epoch 677
Validation auc = 0.611305
Epoch 678
Validation auc = 0.612727
Epoch 679
Loss = 2.2915e-03, PNorm = 95.7461, GNorm = 0.0443, lr_0 = 9.6672e-04
Validation auc = 0.611852
Epoch 680
Validation auc = 0.612563
Epoch 681
Validation auc = 0.611743
Epoch 682
Validation auc = 0.612016
Epoch 683
Loss = 2.4924e-02, PNorm = 95.7908, GNorm = 6.9254, lr_0 = 9.6648e-04
Validation auc = 0.612946
Epoch 684
Validation auc = 0.611798
Epoch 685
Validation auc = 0.607697
Epoch 686
Validation auc = 0.603433
Epoch 687
Validation auc = 0.602121
Epoch 688
Loss = 3.2873e-02, PNorm = 95.8516, GNorm = 0.1324, lr_0 = 9.6624e-04
Loss = 4.0149e-04, PNorm = 95.8547, GNorm = 0.0128, lr_0 = 9.6622e-04
Validation auc = 0.605729
Epoch 689
Validation auc = 0.598622
Epoch 690
Validation auc = 0.591351
Epoch 691
Validation auc = 0.598349
Epoch 692
Validation auc = 0.623551
Epoch 693
Loss = 2.9132e-02, PNorm = 95.9298, GNorm = 1.0081, lr_0 = 9.6600e-04
Validation auc = 0.633337
Epoch 694
Validation auc = 0.634212
Epoch 695
Validation auc = 0.642795
Epoch 696
Validation auc = 0.650120
Epoch 697
Validation auc = 0.654603
Epoch 698
Loss = 1.6671e-01, PNorm = 96.0963, GNorm = 1.7202, lr_0 = 9.6574e-04
Validation auc = 0.654712
Epoch 699
Validation auc = 0.652088
Epoch 700
Validation auc = 0.645692
Epoch 701
Validation auc = 0.642248
Epoch 702
Loss = 4.2480e-03, PNorm = 96.2307, GNorm = 0.0672, lr_0 = 9.6552e-04
Loss = 1.0093e-02, PNorm = 96.2393, GNorm = 0.3940, lr_0 = 9.6550e-04
Validation auc = 0.638804
Epoch 703
Validation auc = 0.634868
Epoch 704
Validation auc = 0.632189
Epoch 705
Validation auc = 0.631205
Epoch 706
Validation auc = 0.627925
Epoch 707
Loss = 2.8577e-02, PNorm = 96.3280, GNorm = 0.3369, lr_0 = 9.6526e-04
Loss = 4.7944e-03, PNorm = 96.3337, GNorm = 0.1129, lr_0 = 9.6525e-04
Validation auc = 0.623169
Epoch 708
Validation auc = 0.619724
Epoch 709
Validation auc = 0.617483
Epoch 710
Validation auc = 0.617210
Epoch 711
Validation auc = 0.614531
Epoch 712
Loss = 3.0148e-03, PNorm = 96.4042, GNorm = 0.2454, lr_0 = 9.6502e-04
Validation auc = 0.613000
Epoch 713
Validation auc = 0.611688
Epoch 714
Validation auc = 0.610649
Epoch 715
Validation auc = 0.608353
Epoch 716
Loss = 7.1166e-04, PNorm = 96.4473, GNorm = 0.0030, lr_0 = 9.6479e-04
Validation auc = 0.606987
Epoch 717
Validation auc = 0.606221
Epoch 718
Validation auc = 0.608517
Epoch 719
Validation auc = 0.610813
Epoch 720
Validation auc = 0.611798
Epoch 721
Loss = 3.6269e-04, PNorm = 96.4794, GNorm = 0.0066, lr_0 = 9.6455e-04
Loss = 3.4372e-06, PNorm = 96.4810, GNorm = 0.0001, lr_0 = 9.6453e-04
Validation auc = 0.611798
Epoch 722
Validation auc = 0.610977
Epoch 723
Validation auc = 0.610048
Epoch 724
Validation auc = 0.609939
Epoch 725
Validation auc = 0.610595
Epoch 726
Loss = 2.0973e-03, PNorm = 96.4869, GNorm = 0.1108, lr_0 = 9.6431e-04
Validation auc = 0.611360
Epoch 727
Validation auc = 0.612563
Epoch 728
Validation auc = 0.613055
Epoch 729
Validation auc = 0.614476
Epoch 730
Validation auc = 0.615242
Epoch 731
Loss = 1.3670e-03, PNorm = 96.5053, GNorm = 0.0296, lr_0 = 9.6405e-04
Validation auc = 0.615843
Epoch 732
Validation auc = 0.616499
Epoch 733
Validation auc = 0.617538
Epoch 734
Validation auc = 0.617538
Epoch 735
Loss = 4.4823e-04, PNorm = 96.5205, GNorm = 0.0085, lr_0 = 9.6383e-04
Loss = 2.4253e-02, PNorm = 96.5217, GNorm = 1.6599, lr_0 = 9.6381e-04
Validation auc = 0.618084
Epoch 736
Validation auc = 0.617264
Epoch 737
Validation auc = 0.617811
Epoch 738
Validation auc = 0.621911
Epoch 739
Validation auc = 0.624918
Epoch 740
Loss = 8.7761e-03, PNorm = 96.5602, GNorm = 2.4943, lr_0 = 9.6357e-04
Loss = 9.5073e-05, PNorm = 96.5631, GNorm = 0.0027, lr_0 = 9.6355e-04
Validation auc = 0.627761
Epoch 741
Validation auc = 0.628362
Epoch 742
Validation auc = 0.628526
Epoch 743
Validation auc = 0.628417
Epoch 744
Validation auc = 0.627269
Epoch 745
Loss = 1.5686e-03, PNorm = 96.6181, GNorm = 0.0267, lr_0 = 9.6333e-04
Validation auc = 0.626011
Epoch 746
Validation auc = 0.625355
Epoch 747
Validation auc = 0.624207
Epoch 748
Validation auc = 0.624426
Epoch 749
Loss = 2.3093e-03, PNorm = 96.6582, GNorm = 0.0238, lr_0 = 9.6309e-04
Validation auc = 0.625082
Epoch 750
Validation auc = 0.625847
Epoch 751
Validation auc = 0.626995
Epoch 752
Validation auc = 0.627050
Epoch 753
Validation auc = 0.629401
Epoch 754
Loss = 9.3375e-04, PNorm = 96.6814, GNorm = 0.0092, lr_0 = 9.6285e-04
Loss = 1.6445e-03, PNorm = 96.6834, GNorm = 0.0734, lr_0 = 9.6284e-04
Validation auc = 0.631205
Epoch 755
Validation auc = 0.634376
Epoch 756
Validation auc = 0.641209
Epoch 757
Validation auc = 0.634868
Epoch 758
Validation auc = 0.631642
Epoch 759
Loss = 2.1091e-03, PNorm = 96.7675, GNorm = 0.0756, lr_0 = 9.6262e-04
Validation auc = 0.627487
Epoch 760
Validation auc = 0.622567
Epoch 761
Validation auc = 0.619451
Epoch 762
Validation auc = 0.617210
Epoch 763
Validation auc = 0.618740
Epoch 764
Loss = 9.9702e-02, PNorm = 96.8422, GNorm = 1.3070, lr_0 = 9.6236e-04
Validation auc = 0.625246
Epoch 765
Validation auc = 0.630986
Epoch 766
Validation auc = 0.635469
Epoch 767
Validation auc = 0.637437
Epoch 768
Loss = 5.5850e-03, PNorm = 96.8824, GNorm = 0.0768, lr_0 = 9.6214e-04
Loss = 4.7932e-04, PNorm = 96.8862, GNorm = 0.0144, lr_0 = 9.6212e-04
Validation auc = 0.637656
Epoch 769
Validation auc = 0.638202
Epoch 770
Validation auc = 0.638531
Epoch 771
Validation auc = 0.638585
Epoch 772
Validation auc = 0.638093
Epoch 773
Loss = 3.4712e-03, PNorm = 96.9402, GNorm = 0.1793, lr_0 = 9.6188e-04
Loss = 1.7105e-03, PNorm = 96.9431, GNorm = 0.0879, lr_0 = 9.6186e-04
Validation auc = 0.638421
Epoch 774
Validation auc = 0.637601
Epoch 775
Validation auc = 0.636562
Epoch 776
Validation auc = 0.635524
Epoch 777
Validation auc = 0.632900
Epoch 778
Loss = 4.8277e-03, PNorm = 96.9697, GNorm = 0.2250, lr_0 = 9.6164e-04
Validation auc = 0.634321
Epoch 779
Validation auc = 0.634704
Epoch 780
Validation auc = 0.634868
Epoch 781
Validation auc = 0.634430
Epoch 782
Validation auc = 0.633556
Epoch 783
Loss = 1.0146e-03, PNorm = 96.9919, GNorm = 0.0813, lr_0 = 9.6139e-04
Validation auc = 0.633118
Epoch 784
Validation auc = 0.632736
Epoch 785
Validation auc = 0.632681
Epoch 786
Validation auc = 0.632517
Epoch 787
Loss = 4.4165e-04, PNorm = 97.0052, GNorm = 0.0334, lr_0 = 9.6117e-04
Loss = 1.4862e-04, PNorm = 97.0060, GNorm = 0.0042, lr_0 = 9.6115e-04
Validation auc = 0.632244
Epoch 788
Validation auc = 0.632080
Epoch 789
Validation auc = 0.631424
Epoch 790
Validation auc = 0.630986
Epoch 791
Validation auc = 0.630768
Epoch 792
Loss = 3.2624e-04, PNorm = 97.0155, GNorm = 0.0067, lr_0 = 9.6093e-04
Validation auc = 0.630768
Epoch 793
Validation auc = 0.631260
Epoch 794
Validation auc = 0.631588
Epoch 795
Validation auc = 0.632462
Epoch 796
Validation auc = 0.633009
Epoch 797
Loss = 3.2827e-04, PNorm = 97.0265, GNorm = 0.0144, lr_0 = 9.6067e-04
Validation auc = 0.633064
Epoch 798
Validation auc = 0.632845
Epoch 799
Validation auc = 0.632954
Epoch 800
Validation auc = 0.633173
Epoch 801
Loss = 1.3673e-04, PNorm = 97.0368, GNorm = 0.0024, lr_0 = 9.6045e-04
Loss = 8.3507e-04, PNorm = 97.0375, GNorm = 0.0758, lr_0 = 9.6043e-04
Validation auc = 0.632954
Epoch 802
Validation auc = 0.632954
Epoch 803
Validation auc = 0.632790
Epoch 804
Validation auc = 0.632626
Epoch 805
Validation auc = 0.627323
Epoch 806
Loss = 5.0939e-03, PNorm = 97.0401, GNorm = 0.0262, lr_0 = 9.6019e-04
Loss = 7.9682e-04, PNorm = 97.0410, GNorm = 0.0276, lr_0 = 9.6018e-04
Validation auc = 0.622130
Epoch 807
Validation auc = 0.620107
Epoch 808
Validation auc = 0.621529
Epoch 809
Validation auc = 0.617264
Epoch 810
Validation auc = 0.616663
Epoch 811
Loss = 2.9057e-04, PNorm = 97.0880, GNorm = 0.0070, lr_0 = 9.5996e-04
Validation auc = 0.618030
Epoch 812
Validation auc = 0.618030
Epoch 813
Validation auc = 0.620818
Epoch 814
Validation auc = 0.622895
Epoch 815
Validation auc = 0.625629
Epoch 816
Loss = 2.1100e-04, PNorm = 97.1534, GNorm = 0.0046, lr_0 = 9.5970e-04
Validation auc = 0.627815
Epoch 817
Validation auc = 0.628471
Epoch 818
Validation auc = 0.629674
Epoch 819
Validation auc = 0.631150
Epoch 820
Loss = 6.2213e-04, PNorm = 97.1899, GNorm = 0.0063, lr_0 = 9.5948e-04
Loss = 4.5627e-03, PNorm = 97.1920, GNorm = 0.3666, lr_0 = 9.5946e-04
Validation auc = 0.631916
Epoch 821
Validation auc = 0.638968
Epoch 822
Validation auc = 0.646293
Epoch 823
Validation auc = 0.653291
Epoch 824
Validation auc = 0.656790
Epoch 825
Loss = 1.5658e-01, PNorm = 97.2276, GNorm = 4.3152, lr_0 = 9.5924e-04
Validation auc = 0.666412
Epoch 826
Validation auc = 0.671386
Epoch 827
Validation auc = 0.675815
Epoch 828
Validation auc = 0.677837
Epoch 829
Validation auc = 0.678657
Epoch 830
Loss = 2.4871e-03, PNorm = 97.2746, GNorm = 0.1377, lr_0 = 9.5899e-04
Validation auc = 0.679259
Epoch 831
Validation auc = 0.676143
Epoch 832
Validation auc = 0.675268
Epoch 833
Validation auc = 0.670621
Epoch 834
Loss = 2.9452e-04, PNorm = 97.3338, GNorm = 0.0077, lr_0 = 9.5877e-04
Loss = 3.5085e-04, PNorm = 97.3400, GNorm = 0.0203, lr_0 = 9.5875e-04
Validation auc = 0.667669
Epoch 835
Validation auc = 0.672097
Epoch 836
Validation auc = 0.674885
Epoch 837
Validation auc = 0.669528
Epoch 838
Validation auc = 0.653838
Epoch 839
Loss = 5.2020e-03, PNorm = 97.4086, GNorm = 0.3813, lr_0 = 9.5851e-04
Loss = 1.4723e-04, PNorm = 97.4153, GNorm = 0.0049, lr_0 = 9.5849e-04
Validation auc = 0.640936
Epoch 840
Validation auc = 0.631861
Epoch 841
Validation auc = 0.629346
Epoch 842
Validation auc = 0.628799
Epoch 843
Validation auc = 0.620982
Epoch 844
Loss = 1.1340e-03, PNorm = 97.5727, GNorm = 0.0189, lr_0 = 9.5827e-04
Validation auc = 0.611962
Epoch 845
Validation auc = 0.627433
Epoch 846
Validation auc = 0.643615
Epoch 847
Validation auc = 0.651815
Epoch 848
Validation auc = 0.658266
Epoch 849
Loss = 3.5467e-02, PNorm = 97.7144, GNorm = 0.6793, lr_0 = 9.5802e-04
Validation auc = 0.661109
Epoch 850
Validation auc = 0.659851
Epoch 851
Validation auc = 0.660999
Epoch 852
Validation auc = 0.663295
Epoch 853
Loss = 3.3314e-02, PNorm = 97.8216, GNorm = 0.7146, lr_0 = 9.5780e-04
Loss = 2.1423e-03, PNorm = 97.8273, GNorm = 0.1008, lr_0 = 9.5778e-04
Validation auc = 0.665045
Epoch 854
Validation auc = 0.667396
Epoch 855
Validation auc = 0.667888
Epoch 856
Validation auc = 0.667232
Epoch 857
Validation auc = 0.667450
Epoch 858
Loss = 1.8421e-03, PNorm = 97.8868, GNorm = 0.0191, lr_0 = 9.5754e-04
Validation auc = 0.668981
Epoch 859
Validation auc = 0.674721
Epoch 860
Validation auc = 0.683523
Epoch 861
Validation auc = 0.688170
Epoch 862
Validation auc = 0.679368
Epoch 863
Loss = 3.1515e-02, PNorm = 98.0033, GNorm = 0.7868, lr_0 = 9.5730e-04
Validation auc = 0.654111
Epoch 864
Validation auc = 0.637328
Epoch 865
Validation auc = 0.625902
Epoch 866
Validation auc = 0.619342
Epoch 867
Loss = 1.7318e-02, PNorm = 98.1705, GNorm = 0.1815, lr_0 = 9.5708e-04
Loss = 2.1923e-02, PNorm = 98.1833, GNorm = 0.3181, lr_0 = 9.5707e-04
Validation auc = 0.617702
Epoch 868
Validation auc = 0.620763
Epoch 869
Validation auc = 0.635141
Epoch 870
Validation auc = 0.642467
Epoch 871
Validation auc = 0.644544
Epoch 872
Loss = 8.0900e-03, PNorm = 98.3419, GNorm = 0.2509, lr_0 = 9.5683e-04
Loss = 4.7760e-03, PNorm = 98.3523, GNorm = 0.1081, lr_0 = 9.5681e-04
Validation auc = 0.644981
Epoch 873
Validation auc = 0.642467
Epoch 874
Validation auc = 0.641373
Epoch 875
Validation auc = 0.634157
Epoch 876
Validation auc = 0.630166
Epoch 877
Loss = 8.7140e-04, PNorm = 98.4732, GNorm = 0.0324, lr_0 = 9.5659e-04
Validation auc = 0.630932
Epoch 878
Validation auc = 0.632134
Epoch 879
Validation auc = 0.632790
Epoch 880
Validation auc = 0.634540
Epoch 881
Validation auc = 0.636508
Epoch 882
Loss = 1.9304e-03, PNorm = 98.5571, GNorm = 0.0949, lr_0 = 9.5634e-04
Validation auc = 0.640335
Epoch 883
Validation auc = 0.643123
Epoch 884
Validation auc = 0.645364
Epoch 885
Validation auc = 0.648043
Epoch 886
Loss = 2.2464e-04, PNorm = 98.5922, GNorm = 0.0299, lr_0 = 9.5612e-04
Loss = 1.0924e-03, PNorm = 98.5937, GNorm = 0.0879, lr_0 = 9.5610e-04
Validation auc = 0.649847
Epoch 887
Validation auc = 0.652143
Epoch 888
Validation auc = 0.647277
Epoch 889
Validation auc = 0.640280
Epoch 890
Validation auc = 0.620545
Epoch 891
Loss = 6.6066e-04, PNorm = 98.6089, GNorm = 0.0295, lr_0 = 9.5586e-04
Validation auc = 0.608627
Epoch 892
Validation auc = 0.601684
Epoch 893
Validation auc = 0.598130
Epoch 894
Validation auc = 0.596764
Epoch 895
Validation auc = 0.598185
Epoch 896
Loss = 1.5075e-03, PNorm = 98.6291, GNorm = 0.0657, lr_0 = 9.5563e-04
Validation auc = 0.599825
Epoch 897
Validation auc = 0.601738
Epoch 898
Validation auc = 0.602449
Epoch 899
Validation auc = 0.603871
Epoch 900
Loss = 1.1295e-03, PNorm = 98.6510, GNorm = 0.0597, lr_0 = 9.5541e-04
Loss = 3.6996e-04, PNorm = 98.6525, GNorm = 0.0138, lr_0 = 9.5539e-04
Validation auc = 0.604855
Epoch 901
Validation auc = 0.607533
Epoch 902
Validation auc = 0.610157
Epoch 903
Validation auc = 0.611469
Epoch 904
Validation auc = 0.613383
Epoch 905
Loss = 3.6945e-04, PNorm = 98.6706, GNorm = 0.0099, lr_0 = 9.5515e-04
Loss = 3.1787e-05, PNorm = 98.6717, GNorm = 0.0011, lr_0 = 9.5513e-04
Validation auc = 0.614968
Epoch 906
Validation auc = 0.616116
Epoch 907
Validation auc = 0.617210
Epoch 908
Validation auc = 0.617647
Epoch 909
Validation auc = 0.618631
Epoch 910
Loss = 3.8639e-04, PNorm = 98.6968, GNorm = 0.0095, lr_0 = 9.5491e-04
Validation auc = 0.603761
Epoch 911
Validation auc = 0.582659
Epoch 912
Validation auc = 0.565493
Epoch 913
Validation auc = 0.553029
Epoch 914
Validation auc = 0.558113
Epoch 915
Loss = 6.1830e-04, PNorm = 98.7400, GNorm = 0.0128, lr_0 = 9.5466e-04
Validation auc = 0.584682
Epoch 916
Validation auc = 0.595397
Epoch 917
Validation auc = 0.589821
Epoch 918
Validation auc = 0.568937
Epoch 919
Loss = 8.0704e-02, PNorm = 98.8564, GNorm = 1.4465, lr_0 = 9.5444e-04
Loss = 2.9246e-03, PNorm = 98.8665, GNorm = 0.1714, lr_0 = 9.5442e-04
Validation auc = 0.553029
Epoch 920
Validation auc = 0.553849
Epoch 921
Validation auc = 0.572217
Epoch 922
Validation auc = 0.591898
Epoch 923
Validation auc = 0.615898
Epoch 924
Loss = 3.5850e-02, PNorm = 99.0519, GNorm = 0.3312, lr_0 = 9.5419e-04
Validation auc = 0.631806
Epoch 925
Validation auc = 0.637218
Epoch 926
Validation auc = 0.641373
Epoch 927
Validation auc = 0.644216
Epoch 928
Validation auc = 0.646403
Epoch 929
Loss = 2.8496e-02, PNorm = 99.2058, GNorm = 0.6398, lr_0 = 9.5395e-04
Validation auc = 0.654986
Epoch 930
Validation auc = 0.667341
Epoch 931
Validation auc = 0.656735
Epoch 932
Validation auc = 0.642357
Epoch 933
Loss = 6.5768e-03, PNorm = 99.3929, GNorm = 0.0037, lr_0 = 9.5371e-04
Validation auc = 0.629291
Epoch 934
Validation auc = 0.621583
Epoch 935
Validation auc = 0.623333
Epoch 936
Validation auc = 0.633118
Epoch 937
Validation auc = 0.618850
Epoch 938
Loss = 9.3884e-03, PNorm = 99.5514, GNorm = 0.3136, lr_0 = 9.5348e-04
Loss = 2.1198e-02, PNorm = 99.5627, GNorm = 0.3501, lr_0 = 9.5346e-04
Validation auc = 0.600864
Epoch 939
Validation auc = 0.593538
Epoch 940
Validation auc = 0.588017
Epoch 941
Validation auc = 0.587962
Epoch 942
Validation auc = 0.588509
Epoch 943
Loss = 5.1549e-03, PNorm = 99.6967, GNorm = 0.0790, lr_0 = 9.5324e-04
Validation auc = 0.589274
Epoch 944
Validation auc = 0.586923
Epoch 945
Validation auc = 0.585447
Epoch 946
Validation auc = 0.583424
Epoch 947
Validation auc = 0.581894
Epoch 948
Loss = 8.0492e-04, PNorm = 99.8093, GNorm = 0.0193, lr_0 = 9.5299e-04
Validation auc = 0.580855
Epoch 949
Validation auc = 0.580254
Epoch 950
Validation auc = 0.578723
Epoch 951
Validation auc = 0.578778
Epoch 952
Loss = 5.6319e-03, PNorm = 99.8594, GNorm = 0.6068, lr_0 = 9.5277e-04
Loss = 4.1411e-04, PNorm = 99.8618, GNorm = 0.0255, lr_0 = 9.5275e-04
Validation auc = 0.576536
Epoch 953
Validation auc = 0.575005
Epoch 954
Validation auc = 0.573475
Epoch 955
Validation auc = 0.571288
Epoch 956
Validation auc = 0.559698
Epoch 957
Loss = 7.5445e-03, PNorm = 99.8925, GNorm = 0.0038, lr_0 = 9.5251e-04
Loss = 1.0232e-02, PNorm = 99.8932, GNorm = 1.8165, lr_0 = 9.5250e-04
Validation auc = 0.567461
Epoch 958
Validation auc = 0.573201
Epoch 959
Validation auc = 0.574896
Epoch 960
Validation auc = 0.577466
Epoch 961
Validation auc = 0.572600
Epoch 962
Loss = 1.1213e-04, PNorm = 99.9192, GNorm = 0.0025, lr_0 = 9.5228e-04
Validation auc = 0.567844
Epoch 963
Validation auc = 0.572600
Epoch 964
Validation auc = 0.579051
Epoch 965
Validation auc = 0.584518
Epoch 966
Loss = 5.3880e-05, PNorm = 99.9489, GNorm = 0.0002, lr_0 = 9.5204e-04
Validation auc = 0.588727
Epoch 967
Validation auc = 0.596490
Epoch 968
Validation auc = 0.611251
Epoch 969
Validation auc = 0.693117
Epoch 970
Validation auc = 0.690520
Epoch 971
Loss = 3.5833e-01, PNorm = 100.3873, GNorm = 3.2031, lr_0 = 9.5180e-04
Loss = 3.4010e-02, PNorm = 100.4426, GNorm = 0.8306, lr_0 = 9.5179e-04
Validation auc = 0.640116
Epoch 972
Validation auc = 0.622294
Epoch 973
Validation auc = 0.618412
Epoch 974
Validation auc = 0.620982
Epoch 975
Validation auc = 0.615898
Epoch 976
Loss = 4.1222e-02, PNorm = 101.0282, GNorm = 0.4068, lr_0 = 9.5157e-04
Validation auc = 0.611305
Epoch 977
Validation auc = 0.607315
Epoch 978
Validation auc = 0.604472
Epoch 979
Validation auc = 0.604144
Epoch 980
Validation auc = 0.601301
Epoch 981
Loss = 1.3953e-02, PNorm = 101.3750, GNorm = 0.3199, lr_0 = 9.5132e-04
Validation auc = 0.600481
Epoch 982
Validation auc = 0.601465
Epoch 983
Validation auc = 0.603269
Epoch 984
Validation auc = 0.605511
Epoch 985
Loss = 5.5576e-03, PNorm = 101.5392, GNorm = 0.1707, lr_0 = 9.5110e-04
Loss = 1.4771e-03, PNorm = 101.5491, GNorm = 0.0412, lr_0 = 9.5108e-04
Validation auc = 0.606659
Epoch 986
Validation auc = 0.606495
Epoch 987
Validation auc = 0.605073
Epoch 988
Validation auc = 0.603871
Epoch 989
Validation auc = 0.602887
Epoch 990
Loss = 1.1578e-03, PNorm = 101.6508, GNorm = 0.0270, lr_0 = 9.5084e-04
Loss = 6.4016e-04, PNorm = 101.6559, GNorm = 0.0175, lr_0 = 9.5083e-04
Validation auc = 0.601246
Epoch 991
Validation auc = 0.607916
Epoch 992
Validation auc = 0.611087
Epoch 993
Validation auc = 0.622021
Epoch 994
Validation auc = 0.626285
Epoch 995
Loss = 7.9228e-04, PNorm = 101.7122, GNorm = 0.0183, lr_0 = 9.5061e-04
Validation auc = 0.628253
Epoch 996
Validation auc = 0.628143
Epoch 997
Validation auc = 0.625629
Epoch 998
Validation auc = 0.620107
Epoch 999
Loss = 4.3050e-02, PNorm = 101.8349, GNorm = 0.1323, lr_0 = 9.5037e-04
Validation auc = 0.618194
Epoch 1000
Validation auc = 0.626339
Epoch 1001
Validation auc = 0.627269
Epoch 1002
Validation auc = 0.633829
Epoch 1003
Validation auc = 0.651268
Epoch 1004
Loss = 8.5674e-03, PNorm = 101.9556, GNorm = 0.1578, lr_0 = 9.5014e-04
Loss = 1.2846e-02, PNorm = 101.9670, GNorm = 0.4683, lr_0 = 9.5012e-04
Validation auc = 0.657774
Epoch 1005
Validation auc = 0.665373
Epoch 1006
Validation auc = 0.668325
Epoch 1007
Validation auc = 0.665373
Epoch 1008
Validation auc = 0.664389
Epoch 1009
Loss = 1.2989e-02, PNorm = 102.1049, GNorm = 0.4559, lr_0 = 9.4990e-04
Validation auc = 0.662475
Epoch 1010
Validation auc = 0.652854
Epoch 1011
Validation auc = 0.645583
Epoch 1012
Validation auc = 0.646184
Epoch 1013
Validation auc = 0.646512
Epoch 1014
Loss = 9.5267e-02, PNorm = 102.2159, GNorm = 1.1762, lr_0 = 9.4965e-04
Validation auc = 0.648262
Epoch 1015
Validation auc = 0.650448
Epoch 1016
Validation auc = 0.648371
Epoch 1017
Validation auc = 0.644599
Epoch 1018
Loss = 2.1068e-03, PNorm = 102.2862, GNorm = 0.0094, lr_0 = 9.4943e-04
Loss = 1.2024e-04, PNorm = 102.2909, GNorm = 0.0036, lr_0 = 9.4941e-04
Validation auc = 0.642357
Epoch 1019
Validation auc = 0.643232
Epoch 1020
Validation auc = 0.643560
Epoch 1021
Validation auc = 0.643997
Epoch 1022
Validation auc = 0.643943
Epoch 1023
Loss = 7.0802e-03, PNorm = 102.3447, GNorm = 0.4181, lr_0 = 9.4918e-04
Loss = 5.6530e-04, PNorm = 102.3476, GNorm = 0.0162, lr_0 = 9.4916e-04
Validation auc = 0.644872
Epoch 1024
Validation auc = 0.645145
Epoch 1025
Validation auc = 0.646293
Epoch 1026
Validation auc = 0.646457
Epoch 1027
Validation auc = 0.646512
Epoch 1028
Loss = 1.6810e-03, PNorm = 102.3766, GNorm = 0.0863, lr_0 = 9.4894e-04
Validation auc = 0.646293
Epoch 1029
Validation auc = 0.646293
Epoch 1030
Validation auc = 0.649847
Epoch 1031
Validation auc = 0.653291
Epoch 1032
Validation auc = 0.657501
Epoch 1033
Loss = 6.2686e-04, PNorm = 102.4055, GNorm = 0.0299, lr_0 = 9.4869e-04
Validation auc = 0.660125
Epoch 1034
Validation auc = 0.662421
Epoch 1035
Validation auc = 0.664717
Epoch 1036
Validation auc = 0.664717
Epoch 1037
Loss = 5.3778e-03, PNorm = 102.4321, GNorm = 0.0043, lr_0 = 9.4847e-04
Loss = 9.1003e-02, PNorm = 102.4349, GNorm = 6.0045, lr_0 = 9.4845e-04
Validation auc = 0.654986
Epoch 1038
Validation auc = 0.645747
Epoch 1039
Validation auc = 0.640061
Epoch 1040
Validation auc = 0.632626
Epoch 1041
Validation auc = 0.629510
Epoch 1042
Loss = 2.7926e-03, PNorm = 102.5258, GNorm = 0.0649, lr_0 = 9.4823e-04
Validation auc = 0.635196
Epoch 1043
Validation auc = 0.643123
Epoch 1044
Validation auc = 0.648152
Epoch 1045
Validation auc = 0.649246
Epoch 1046
Validation auc = 0.650284
Epoch 1047
Loss = 6.9518e-04, PNorm = 102.6709, GNorm = 0.0144, lr_0 = 9.4798e-04
Validation auc = 0.626285
Epoch 1048
Validation auc = 0.643396
Epoch 1049
Validation auc = 0.648699
Epoch 1050
Validation auc = 0.643779
Epoch 1051
Loss = 7.2840e-03, PNorm = 102.7792, GNorm = 1.0944, lr_0 = 9.4776e-04
Loss = 8.8356e-04, PNorm = 102.7864, GNorm = 0.0400, lr_0 = 9.4775e-04
Validation auc = 0.641592
Epoch 1052
Validation auc = 0.646403
Epoch 1053
Validation auc = 0.650066
Epoch 1054
Validation auc = 0.650503
Epoch 1055
Validation auc = 0.649792
Epoch 1056
Loss = 3.8890e-03, PNorm = 102.8751, GNorm = 0.4916, lr_0 = 9.4751e-04
Loss = 3.9275e-05, PNorm = 102.8809, GNorm = 0.0020, lr_0 = 9.4749e-04
Validation auc = 0.646239
Epoch 1057
Validation auc = 0.648808
Epoch 1058
Validation auc = 0.653510
Epoch 1059
Validation auc = 0.661382
Epoch 1060
Validation auc = 0.674503
Epoch 1061
Loss = 4.1687e-02, PNorm = 103.0272, GNorm = 1.7116, lr_0 = 9.4728e-04
Validation auc = 0.681664
Epoch 1062
Validation auc = 0.678056
Epoch 1063
Validation auc = 0.668052
Epoch 1064
Validation auc = 0.651378
Epoch 1065
Validation auc = 0.640936
Epoch 1066
Loss = 4.3762e-02, PNorm = 103.2991, GNorm = 2.0809, lr_0 = 9.4702e-04
Validation auc = 0.644380
Epoch 1067
Validation auc = 0.644107
Epoch 1068
Validation auc = 0.642357
Epoch 1069
Validation auc = 0.643068
Epoch 1070
Loss = 1.9428e-02, PNorm = 103.4563, GNorm = 0.0446, lr_0 = 9.4681e-04
Loss = 2.5398e-03, PNorm = 103.4646, GNorm = 0.0690, lr_0 = 9.4679e-04
Validation auc = 0.647332
Epoch 1071
Validation auc = 0.647606
Epoch 1072
Validation auc = 0.644544
Epoch 1073
Validation auc = 0.641811
Epoch 1074
Validation auc = 0.644325
Epoch 1075
Loss = 2.1113e-03, PNorm = 103.5312, GNorm = 0.0509, lr_0 = 9.4657e-04
Validation auc = 0.652908
Epoch 1076
Validation auc = 0.652198
Epoch 1077
Validation auc = 0.649082
Epoch 1078
Validation auc = 0.647113
Epoch 1079
Validation auc = 0.647004
Epoch 1080
Loss = 6.5549e-02, PNorm = 103.6270, GNorm = 0.5948, lr_0 = 9.4632e-04
Validation auc = 0.647660
Epoch 1081
Validation auc = 0.646239
Epoch 1082
Validation auc = 0.645145
Epoch 1083
Validation auc = 0.643505
Epoch 1084
Loss = 1.0780e-02, PNorm = 103.6700, GNorm = 0.3077, lr_0 = 9.4610e-04
Loss = 9.2713e-03, PNorm = 103.6741, GNorm = 0.1843, lr_0 = 9.4608e-04
Validation auc = 0.641483
Epoch 1085
Validation auc = 0.640171
Epoch 1086
Validation auc = 0.637437
Epoch 1087
Validation auc = 0.636398
Epoch 1088
Validation auc = 0.634212
Epoch 1089
Loss = 3.1022e-03, PNorm = 103.7336, GNorm = 0.1344, lr_0 = 9.4585e-04
Loss = 1.9266e-03, PNorm = 103.7376, GNorm = 0.0425, lr_0 = 9.4583e-04
Validation auc = 0.632134
Epoch 1090
Validation auc = 0.629510
Epoch 1091
Validation auc = 0.630221
Epoch 1092
Validation auc = 0.629784
Epoch 1093
Validation auc = 0.629565
Epoch 1094
Loss = 2.0762e-03, PNorm = 103.7876, GNorm = 0.1338, lr_0 = 9.4561e-04
Validation auc = 0.625355
Epoch 1095
Validation auc = 0.618904
Epoch 1096
Validation auc = 0.614722
Epoch 1097
Validation auc = 0.610431
Epoch 1098
Validation auc = 0.605784
Epoch 1099
Loss = 4.3597e-02, PNorm = 103.8456, GNorm = 2.4175, lr_0 = 9.4536e-04
Validation auc = 0.604800
Epoch 1100
Validation auc = 0.607643
Epoch 1101
Validation auc = 0.609501
Epoch 1102
Validation auc = 0.621146
Epoch 1103
Loss = 1.4506e-03, PNorm = 103.8897, GNorm = 0.0270, lr_0 = 9.4515e-04
Loss = 4.2554e-04, PNorm = 103.8949, GNorm = 0.0126, lr_0 = 9.4513e-04
Validation auc = 0.631314
Epoch 1104
Validation auc = 0.639624
Epoch 1105
Validation auc = 0.647934
Epoch 1106
Validation auc = 0.658594
Epoch 1107
Validation auc = 0.649902
Epoch 1108
Loss = 6.1444e-03, PNorm = 104.0164, GNorm = 0.0450, lr_0 = 9.4489e-04
Validation auc = 0.639132
Epoch 1109
Validation auc = 0.626066
Epoch 1110
Validation auc = 0.622841
Epoch 1111
Validation auc = 0.623005
Epoch 1112
Validation auc = 0.622239
Epoch 1113
Loss = 1.0536e-01, PNorm = 104.1614, GNorm = 0.8446, lr_0 = 9.4466e-04
Validation auc = 0.619178
Epoch 1114
Validation auc = 0.614750
Epoch 1115
Validation auc = 0.611907
Epoch 1116
Validation auc = 0.605019
Epoch 1117
Loss = 5.1641e-02, PNorm = 104.2418, GNorm = 1.5353, lr_0 = 9.4444e-04
Loss = 4.6113e-03, PNorm = 104.2464, GNorm = 0.1171, lr_0 = 9.4443e-04
Validation auc = 0.603597
Epoch 1118
Validation auc = 0.608572
Epoch 1119
Validation auc = 0.611305
Epoch 1120
Validation auc = 0.613274
Epoch 1121
Validation auc = 0.614148
Epoch 1122
Loss = 2.1172e-02, PNorm = 104.3219, GNorm = 0.8633, lr_0 = 9.4419e-04
Loss = 7.2034e-05, PNorm = 104.3261, GNorm = 0.0023, lr_0 = 9.4417e-04
Validation auc = 0.615624
Epoch 1123
Validation auc = 0.614586
Epoch 1124
Validation auc = 0.615898
Epoch 1125
Validation auc = 0.614422
Epoch 1126
Validation auc = 0.621365
Epoch 1127
Loss = 2.3948e-03, PNorm = 104.3786, GNorm = 0.0795, lr_0 = 9.4396e-04
Validation auc = 0.628799
Epoch 1128
Validation auc = 0.632298
Epoch 1129
Validation auc = 0.629893
Epoch 1130
Validation auc = 0.627269
Epoch 1131
Validation auc = 0.625137
Epoch 1132
Loss = 7.1408e-04, PNorm = 104.4574, GNorm = 0.0233, lr_0 = 9.4371e-04
Validation auc = 0.623989
Epoch 1133
Validation auc = 0.622950
Epoch 1134
Validation auc = 0.622349
Epoch 1135
Validation auc = 0.625246
Epoch 1136
Loss = 8.6231e-04, PNorm = 104.4944, GNorm = 0.0184, lr_0 = 9.4349e-04
Loss = 2.2002e-04, PNorm = 104.4968, GNorm = 0.0067, lr_0 = 9.4347e-04
Validation auc = 0.629674
Epoch 1137
Validation auc = 0.631205
Epoch 1138
Validation auc = 0.632572
Epoch 1139
Validation auc = 0.631424
Epoch 1140
Validation auc = 0.630057
Epoch 1141
Loss = 7.1917e-04, PNorm = 104.5428, GNorm = 0.0322, lr_0 = 9.4324e-04
Validation auc = 0.627542
Epoch 1142
Validation auc = 0.626066
Epoch 1143
Validation auc = 0.626121
Epoch 1144
Validation auc = 0.625137
Epoch 1145
Validation auc = 0.624863
Epoch 1146
Loss = 6.2618e-04, PNorm = 104.5749, GNorm = 0.0133, lr_0 = 9.4300e-04
Validation auc = 0.624262
Epoch 1147
Validation auc = 0.624207
Epoch 1148
Validation auc = 0.624153
Epoch 1149
Validation auc = 0.623879
Epoch 1150
Loss = 1.7747e-02, PNorm = 104.5931, GNorm = 0.0049, lr_0 = 9.4279e-04
Loss = 1.3916e-04, PNorm = 104.5943, GNorm = 0.0044, lr_0 = 9.4277e-04
Validation auc = 0.621966
Epoch 1151
Validation auc = 0.620709
Epoch 1152
Validation auc = 0.617811
Epoch 1153
Validation auc = 0.609829
Epoch 1154
Validation auc = 0.601629
Epoch 1155
Loss = 1.1779e-02, PNorm = 104.6269, GNorm = 0.0015, lr_0 = 9.4253e-04
Loss = 1.2020e-05, PNorm = 104.6300, GNorm = 0.0005, lr_0 = 9.4252e-04
Validation auc = 0.599442
Epoch 1156
Validation auc = 0.597802
Epoch 1157
Validation auc = 0.595342
Epoch 1158
Validation auc = 0.589383
Epoch 1159
Validation auc = 0.584190
Epoch 1160
Loss = 1.3921e-03, PNorm = 104.7108, GNorm = 0.0441, lr_0 = 9.4230e-04
Validation auc = 0.578668
Epoch 1161
Validation auc = 0.576700
Epoch 1162
Validation auc = 0.574513
Epoch 1163
Validation auc = 0.572873
Epoch 1164
Validation auc = 0.577356
Epoch 1165
Loss = 3.3454e-04, PNorm = 104.7775, GNorm = 0.0083, lr_0 = 9.4205e-04
Validation auc = 0.579762
Epoch 1166
Validation auc = 0.581784
Epoch 1167
Validation auc = 0.583698
Epoch 1168
Validation auc = 0.585666
Epoch 1169
Loss = 1.8706e-03, PNorm = 104.8050, GNorm = 0.1130, lr_0 = 9.4183e-04
Loss = 7.6576e-04, PNorm = 104.8075, GNorm = 0.0238, lr_0 = 9.4182e-04
Validation auc = 0.586486
Epoch 1170
Validation auc = 0.587306
Epoch 1171
Validation auc = 0.590094
Epoch 1172
Validation auc = 0.592937
Epoch 1173
Validation auc = 0.595616
Epoch 1174
Loss = 5.5617e-03, PNorm = 104.8323, GNorm = 0.1401, lr_0 = 9.4158e-04
Validation auc = 0.597037
Epoch 1175
Validation auc = 0.597092
Epoch 1176
Validation auc = 0.597037
Epoch 1177
Validation auc = 0.597748
Epoch 1178
Validation auc = 0.597420
Epoch 1179
Loss = 1.4625e-03, PNorm = 104.8686, GNorm = 0.0555, lr_0 = 9.4135e-04
Validation auc = 0.596709
Epoch 1180
Validation auc = 0.607479
Epoch 1181
Validation auc = 0.606385
Epoch 1182
Validation auc = 0.601028
Epoch 1183
Loss = 6.6299e-03, PNorm = 104.9080, GNorm = 1.5080, lr_0 = 9.4112e-04
Validation auc = 0.598130
Epoch 1184
Validation auc = 0.608845
Epoch 1185
Validation auc = 0.615460
Epoch 1186
Validation auc = 0.620545
Epoch 1187
Validation auc = 0.624535
Epoch 1188
Loss = 1.7734e-03, PNorm = 104.9473, GNorm = 0.0497, lr_0 = 9.4088e-04
Loss = 2.2742e-04, PNorm = 104.9501, GNorm = 0.0074, lr_0 = 9.4087e-04
Validation auc = 0.625902
Epoch 1189
Validation auc = 0.627378
Epoch 1190
Validation auc = 0.627979
Epoch 1191
Validation auc = 0.626558
Epoch 1192
Validation auc = 0.626121
Epoch 1193
Loss = 1.6581e-04, PNorm = 104.9874, GNorm = 0.0064, lr_0 = 9.4065e-04
Validation auc = 0.625629
Epoch 1194
Validation auc = 0.624426
Epoch 1195
Validation auc = 0.624098
Epoch 1196
Validation auc = 0.623606
Epoch 1197
Validation auc = 0.623770
Epoch 1198
Loss = 2.0572e-05, PNorm = 105.0131, GNorm = 0.0006, lr_0 = 9.4040e-04
Validation auc = 0.623497
Epoch 1199
Validation auc = 0.622622
Epoch 1200
Validation auc = 0.622075
Epoch 1201
Validation auc = 0.621419
Epoch 1202
Loss = 4.8285e-05, PNorm = 105.0221, GNorm = 0.0064, lr_0 = 9.4018e-04
Loss = 1.0907e-05, PNorm = 105.0226, GNorm = 0.0004, lr_0 = 9.4016e-04
Validation auc = 0.621474
Epoch 1203
Validation auc = 0.621638
Epoch 1204
Validation auc = 0.621802
Epoch 1205
Validation auc = 0.621583
Epoch 1206
Validation auc = 0.621638
Epoch 1207
Loss = 1.3015e-05, PNorm = 105.0273, GNorm = 0.0002, lr_0 = 9.3993e-04
Loss = 1.2259e-04, PNorm = 105.0276, GNorm = 0.0036, lr_0 = 9.3991e-04
Validation auc = 0.621474
Epoch 1208
Validation auc = 0.621419
Epoch 1209
Validation auc = 0.620709
Epoch 1210
Validation auc = 0.618904
Epoch 1211
Validation auc = 0.620435
Epoch 1212
Loss = 2.2233e-04, PNorm = 105.0374, GNorm = 0.0091, lr_0 = 9.3970e-04
Validation auc = 0.623005
Epoch 1213
Validation auc = 0.625629
Epoch 1214
Validation auc = 0.623387
Epoch 1215
Validation auc = 0.611634
Epoch 1216
Loss = 2.4835e-03, PNorm = 105.0759, GNorm = 0.0004, lr_0 = 9.3946e-04
Validation auc = 0.606713
Epoch 1217
Validation auc = 0.600973
Epoch 1218
Validation auc = 0.597912
Epoch 1219
Validation auc = 0.596545
Epoch 1220
Validation auc = 0.596490
Epoch 1221
Loss = 1.8128e-02, PNorm = 105.1170, GNorm = 2.4537, lr_0 = 9.3923e-04
Loss = 7.7486e-07, PNorm = 105.1184, GNorm = 0.0000, lr_0 = 9.3922e-04
Validation auc = 0.604417
Epoch 1222
Validation auc = 0.617811
Epoch 1223
Validation auc = 0.626722
Epoch 1224
Validation auc = 0.624153
Epoch 1225
Validation auc = 0.620873
Epoch 1226
Loss = 8.1728e-04, PNorm = 105.1428, GNorm = 0.0751, lr_0 = 9.3900e-04
Validation auc = 0.619232
Epoch 1227
Validation auc = 0.617975
Epoch 1228
Validation auc = 0.620654
Epoch 1229
Validation auc = 0.624098
Epoch 1230
Validation auc = 0.627159
Epoch 1231
Loss = 4.5842e-04, PNorm = 105.1563, GNorm = 0.0150, lr_0 = 9.3875e-04
Validation auc = 0.629510
Epoch 1232
Validation auc = 0.630494
Epoch 1233
Validation auc = 0.631424
Epoch 1234
Validation auc = 0.631533
Epoch 1235
Loss = 3.6603e-04, PNorm = 105.1661, GNorm = 0.0110, lr_0 = 9.3853e-04
Loss = 5.3024e-04, PNorm = 105.1668, GNorm = 0.0179, lr_0 = 9.3852e-04
Validation auc = 0.631861
Epoch 1236
Validation auc = 0.631861
Epoch 1237
Validation auc = 0.631861
Epoch 1238
Validation auc = 0.634704
Epoch 1239
Validation auc = 0.638038
Epoch 1240
Loss = 4.2092e-03, PNorm = 105.1812, GNorm = 0.3543, lr_0 = 9.3828e-04
Loss = 1.0166e-03, PNorm = 105.1837, GNorm = 0.0784, lr_0 = 9.3827e-04
Validation auc = 0.638859
Epoch 1241
Validation auc = 0.638968
Epoch 1242
Validation auc = 0.636508
Epoch 1243
Validation auc = 0.635742
Epoch 1244
Validation auc = 0.634376
Epoch 1245
Loss = 1.8420e-03, PNorm = 105.2190, GNorm = 0.1565, lr_0 = 9.3805e-04
Validation auc = 0.635141
Epoch 1246
Validation auc = 0.635360
Epoch 1247
Validation auc = 0.635196
Epoch 1248
Validation auc = 0.634977
Epoch 1249
Loss = 1.0954e-04, PNorm = 105.2385, GNorm = 0.0010, lr_0 = 9.3782e-04
Validation auc = 0.634430
Epoch 1250
Validation auc = 0.634048
Epoch 1251
Validation auc = 0.633774
Epoch 1252
Validation auc = 0.633392
Epoch 1253
Validation auc = 0.632244
Epoch 1254
Loss = 5.3619e-04, PNorm = 105.2484, GNorm = 0.0168, lr_0 = 9.3758e-04
Loss = 2.3501e-03, PNorm = 105.2496, GNorm = 0.1495, lr_0 = 9.3757e-04
Validation auc = 0.631478
Epoch 1255
Validation auc = 0.630440
Epoch 1256
Validation auc = 0.627870
Epoch 1257
Validation auc = 0.627214
Epoch 1258
Validation auc = 0.625301
Epoch 1259
Loss = 8.9679e-05, PNorm = 105.2729, GNorm = 0.0023, lr_0 = 9.3735e-04
Validation auc = 0.623387
Epoch 1260
Validation auc = 0.623497
Epoch 1261
Validation auc = 0.626558
Epoch 1262
Validation auc = 0.628253
Epoch 1263
Validation auc = 0.627542
Epoch 1264
Loss = 2.3674e-04, PNorm = 105.3169, GNorm = 0.0086, lr_0 = 9.3710e-04
Validation auc = 0.625082
Epoch 1265
Validation auc = 0.622294
Epoch 1266
Validation auc = 0.623114
Epoch 1267
Validation auc = 0.624863
Epoch 1268
Loss = 6.7340e-04, PNorm = 105.3649, GNorm = 0.0253, lr_0 = 9.3689e-04
Loss = 4.2415e-03, PNorm = 105.3704, GNorm = 0.4185, lr_0 = 9.3687e-04
Validation auc = 0.627323
Epoch 1269
Validation auc = 0.626339
Epoch 1270
Validation auc = 0.623879
Epoch 1271
Validation auc = 0.620326
Epoch 1272
Validation auc = 0.615679
Epoch 1273
Loss = 8.3724e-05, PNorm = 105.4350, GNorm = 0.0025, lr_0 = 9.3664e-04
Loss = 4.2416e-05, PNorm = 105.4381, GNorm = 0.0015, lr_0 = 9.3662e-04
Validation auc = 0.614148
Epoch 1274
Validation auc = 0.611251
Epoch 1275
Validation auc = 0.608517
Epoch 1276
Validation auc = 0.606823
Epoch 1277
Validation auc = 0.605839
Epoch 1278
Loss = 4.0801e-05, PNorm = 105.4623, GNorm = 0.0009, lr_0 = 9.3641e-04
Validation auc = 0.608299
Epoch 1279
Validation auc = 0.611524
Epoch 1280
Validation auc = 0.612727
Epoch 1281
Validation auc = 0.614039
Epoch 1282
Validation auc = 0.615078
Epoch 1283
Loss = 3.4694e-04, PNorm = 105.4877, GNorm = 0.0182, lr_0 = 9.3616e-04
Validation auc = 0.615406
Epoch 1284
Validation auc = 0.615187
Epoch 1285
Validation auc = 0.613984
Epoch 1286
Validation auc = 0.612727
Epoch 1287
Loss = 1.8768e-04, PNorm = 105.5036, GNorm = 0.0028, lr_0 = 9.3594e-04
Loss = 2.7815e-07, PNorm = 105.5047, GNorm = 0.0000, lr_0 = 9.3592e-04
Validation auc = 0.611743
Epoch 1288
Validation auc = 0.610923
Epoch 1289
Validation auc = 0.611141
Epoch 1290
Validation auc = 0.610267
Epoch 1291
Validation auc = 0.609283
Epoch 1292
Loss = 2.1842e-05, PNorm = 105.5150, GNorm = 0.0009, lr_0 = 9.3571e-04
Validation auc = 0.608955
Epoch 1293
Validation auc = 0.608408
Epoch 1294
Validation auc = 0.608244
Epoch 1295
Validation auc = 0.608244
Epoch 1296
Validation auc = 0.608189
Epoch 1297
Loss = 5.8693e-05, PNorm = 105.5219, GNorm = 0.0014, lr_0 = 9.3546e-04
Validation auc = 0.608408
Epoch 1298
Validation auc = 0.608189
Epoch 1299
Validation auc = 0.607971
Epoch 1300
Validation auc = 0.607807
Epoch 1301
Loss = 1.6438e-04, PNorm = 105.5260, GNorm = 0.0036, lr_0 = 9.3524e-04
Loss = 2.8192e-05, PNorm = 105.5263, GNorm = 0.0013, lr_0 = 9.3523e-04
Validation auc = 0.607971
Epoch 1302
Validation auc = 0.608080
Epoch 1303
Validation auc = 0.611251
Epoch 1304
Validation auc = 0.615515
Epoch 1305
Validation auc = 0.616882
Epoch 1306
Loss = 8.7916e-04, PNorm = 105.5188, GNorm = 0.0141, lr_0 = 9.3499e-04
Loss = 4.2973e-05, PNorm = 105.5192, GNorm = 0.0019, lr_0 = 9.3498e-04
Validation auc = 0.618248
Epoch 1307
Validation auc = 0.616226
Epoch 1308
Validation auc = 0.601902
Epoch 1309
Validation auc = 0.612946
Epoch 1310
Validation auc = 0.647059
Epoch 1311
Loss = 3.2526e-04, PNorm = 105.5361, GNorm = 0.0081, lr_0 = 9.3476e-04
Validation auc = 0.666193
Epoch 1312
Validation auc = 0.675651
Epoch 1313
Validation auc = 0.669473
Epoch 1314
Validation auc = 0.660671
Epoch 1315
Validation auc = 0.653291
Epoch 1316
Loss = 4.3564e-03, PNorm = 105.6567, GNorm = 0.1319, lr_0 = 9.3451e-04
Validation auc = 0.648316
Epoch 1317
Validation auc = 0.647496
Epoch 1318
Validation auc = 0.649246
Epoch 1319
Validation auc = 0.650612
Epoch 1320
Loss = 6.8357e-03, PNorm = 105.7503, GNorm = 0.7839, lr_0 = 9.3430e-04
Loss = 2.7517e-05, PNorm = 105.7564, GNorm = 0.0010, lr_0 = 9.3428e-04
Validation auc = 0.652143
Epoch 1321
Validation auc = 0.653072
Epoch 1322
Validation auc = 0.654275
Epoch 1323
Validation auc = 0.654548
Epoch 1324
Validation auc = 0.655696
Epoch 1325
Loss = 5.3293e-03, PNorm = 105.8391, GNorm = 0.4499, lr_0 = 9.3407e-04
Validation auc = 0.655751
Epoch 1326
Validation auc = 0.655587
Epoch 1327
Validation auc = 0.653947
Epoch 1328
Validation auc = 0.642412
Epoch 1329
Validation auc = 0.634649
Epoch 1330
Loss = 1.0541e-02, PNorm = 105.9085, GNorm = 0.6263, lr_0 = 9.3382e-04
Validation auc = 0.633829
Epoch 1331
Validation auc = 0.625355
Epoch 1332
Validation auc = 0.628253
Epoch 1333
Validation auc = 0.633774
Epoch 1334
Loss = 1.3847e-03, PNorm = 105.9560, GNorm = 0.0032, lr_0 = 9.3360e-04
Loss = 3.6337e-05, PNorm = 105.9592, GNorm = 0.0018, lr_0 = 9.3359e-04
Validation auc = 0.641647
Epoch 1335
Validation auc = 0.645965
Epoch 1336
Validation auc = 0.649628
Epoch 1337
Validation auc = 0.651104
Epoch 1338
Validation auc = 0.651870
Epoch 1339
Loss = 8.2570e-02, PNorm = 105.9866, GNorm = 2.7923, lr_0 = 9.3336e-04
Loss = 4.4360e-03, PNorm = 105.9883, GNorm = 0.2692, lr_0 = 9.3334e-04
Validation auc = 0.646129
Epoch 1340
Validation auc = 0.641975
Epoch 1341
Validation auc = 0.639296
Epoch 1342
Validation auc = 0.637984
Epoch 1343
Validation auc = 0.636398
Epoch 1344
Loss = 8.6669e-04, PNorm = 106.0243, GNorm = 0.0246, lr_0 = 9.3312e-04
Validation auc = 0.636344
Epoch 1345
Validation auc = 0.636398
Epoch 1346
Validation auc = 0.635797
Epoch 1347
Validation auc = 0.635196
Epoch 1348
Validation auc = 0.635360
Epoch 1349
Loss = 5.3358e-04, PNorm = 106.0633, GNorm = 0.0112, lr_0 = 9.3288e-04
Validation auc = 0.634813
Epoch 1350
Validation auc = 0.631861
Epoch 1351
Validation auc = 0.629455
Epoch 1352
Validation auc = 0.629565
Epoch 1353
Loss = 7.5225e-03, PNorm = 106.0976, GNorm = 0.7647, lr_0 = 9.3266e-04
Loss = 6.1760e-04, PNorm = 106.1002, GNorm = 0.0217, lr_0 = 9.3264e-04
Validation auc = 0.627870
Epoch 1354
Validation auc = 0.627706
Epoch 1355
Validation auc = 0.627214
Epoch 1356
Validation auc = 0.626339
Epoch 1357
Validation auc = 0.626066
Epoch 1358
Loss = 6.6563e-04, PNorm = 106.1428, GNorm = 0.0066, lr_0 = 9.3241e-04
Validation auc = 0.626066
Epoch 1359
Validation auc = 0.625738
Epoch 1360
Validation auc = 0.625847
Epoch 1361
Validation auc = 0.626011
Epoch 1362
Validation auc = 0.630221
Epoch 1363
Loss = 3.2217e-04, PNorm = 106.1674, GNorm = 0.0085, lr_0 = 9.3218e-04
Validation auc = 0.634922
Epoch 1364
Validation auc = 0.636398
Epoch 1365
Validation auc = 0.636890
Epoch 1366
Validation auc = 0.636890
Epoch 1367
Loss = 3.7450e-04, PNorm = 106.1941, GNorm = 0.0059, lr_0 = 9.3197e-04
Loss = 9.0396e-05, PNorm = 106.1962, GNorm = 0.0042, lr_0 = 9.3195e-04
Validation auc = 0.638366
Epoch 1368
Validation auc = 0.638859
Epoch 1369
Validation auc = 0.638093
Epoch 1370
Validation auc = 0.637437
Epoch 1371
Validation auc = 0.636562
Epoch 1372
Loss = 9.2779e-05, PNorm = 106.2193, GNorm = 0.0029, lr_0 = 9.3172e-04
Loss = 6.8259e-05, PNorm = 106.2206, GNorm = 0.0035, lr_0 = 9.3170e-04
Validation auc = 0.636070
Epoch 1373
Validation auc = 0.635578
Epoch 1374
Validation auc = 0.635469
Epoch 1375
Validation auc = 0.635305
Epoch 1376
Validation auc = 0.634485
Epoch 1377
Loss = 9.3620e-05, PNorm = 106.2329, GNorm = 0.0025, lr_0 = 9.3149e-04
Validation auc = 0.630221
Epoch 1378
Validation auc = 0.624481
Epoch 1379
Validation auc = 0.620654
Epoch 1380
Validation auc = 0.620709
Epoch 1381
Validation auc = 0.621857
Epoch 1382
Loss = 2.0432e-04, PNorm = 106.2560, GNorm = 0.0055, lr_0 = 9.3124e-04
Validation auc = 0.623223
Epoch 1383
Validation auc = 0.624371
Epoch 1384
Validation auc = 0.624481
Epoch 1385
Validation auc = 0.625738
Epoch 1386
Loss = 1.3485e-02, PNorm = 106.2787, GNorm = 2.0255, lr_0 = 9.3102e-04
Loss = 8.8233e-05, PNorm = 106.2806, GNorm = 0.0043, lr_0 = 9.3101e-04
Validation auc = 0.626011
Epoch 1387
Validation auc = 0.626995
Epoch 1388
Validation auc = 0.627159
Epoch 1389
Validation auc = 0.626011
Epoch 1390
Validation auc = 0.625683
Epoch 1391
Loss = 2.1591e-05, PNorm = 106.3120, GNorm = 0.0008, lr_0 = 9.3078e-04
Validation auc = 0.625410
Epoch 1392
Validation auc = 0.625137
Epoch 1393
Validation auc = 0.627761
Epoch 1394
Validation auc = 0.631861
Epoch 1395
Validation auc = 0.644380
Epoch 1396
Loss = 1.3493e-05, PNorm = 106.3516, GNorm = 0.0004, lr_0 = 9.3055e-04
Validation auc = 0.650722
Epoch 1397
Validation auc = 0.655532
Epoch 1398
Validation auc = 0.658430
Epoch 1399
Validation auc = 0.644325
Epoch 1400
Loss = 9.7613e-05, PNorm = 106.4055, GNorm = 0.0040, lr_0 = 9.3033e-04
Loss = 2.0205e-05, PNorm = 106.4134, GNorm = 0.0010, lr_0 = 9.3032e-04
Validation auc = 0.639023
Epoch 1401
Validation auc = 0.628198
Epoch 1402
Validation auc = 0.637492
Epoch 1403
Validation auc = 0.642139
Epoch 1404
Validation auc = 0.641264
Epoch 1405
Loss = 9.8649e-02, PNorm = 106.5612, GNorm = 2.6019, lr_0 = 9.3008e-04
Loss = 1.3110e-02, PNorm = 106.5728, GNorm = 0.3231, lr_0 = 9.3007e-04
Validation auc = 0.648316
Epoch 1406
Validation auc = 0.649136
Epoch 1407
Validation auc = 0.650667
Epoch 1408
Validation auc = 0.651706
Epoch 1409
Validation auc = 0.652252
Epoch 1410
Loss = 7.0357e-04, PNorm = 106.7332, GNorm = 0.0131, lr_0 = 9.2985e-04
Validation auc = 0.653892
Epoch 1411
Validation auc = 0.655970
Epoch 1412
Validation auc = 0.655806
Epoch 1413
Validation auc = 0.658157
Epoch 1414
Validation auc = 0.659633
Epoch 1415
Loss = 4.2056e-02, PNorm = 106.8246, GNorm = 0.3645, lr_0 = 9.2961e-04
Validation auc = 0.660945
Epoch 1416
Validation auc = 0.661546
Epoch 1417
Validation auc = 0.661983
Epoch 1418
Validation auc = 0.662366
Epoch 1419
Loss = 1.8462e-03, PNorm = 106.9002, GNorm = 0.0175, lr_0 = 9.2939e-04
Loss = 6.4293e-03, PNorm = 106.9052, GNorm = 0.1581, lr_0 = 9.2938e-04
Validation auc = 0.662749
Epoch 1420
Validation auc = 0.661765
Epoch 1421
Validation auc = 0.662093
Epoch 1422
Validation auc = 0.661601
Epoch 1423
Validation auc = 0.660999
Epoch 1424
Loss = 3.2541e-03, PNorm = 106.9546, GNorm = 0.1102, lr_0 = 9.2914e-04
Validation auc = 0.659851
Epoch 1425
Validation auc = 0.661054
Epoch 1426
Validation auc = 0.660671
Epoch 1427
Validation auc = 0.659961
Epoch 1428
Validation auc = 0.660179
Epoch 1429
Loss = 3.0415e-04, PNorm = 106.9781, GNorm = 0.0073, lr_0 = 9.2891e-04
Validation auc = 0.660070
Epoch 1430
Validation auc = 0.659851
Epoch 1431
Validation auc = 0.660070
Epoch 1432
Validation auc = 0.660562
Epoch 1433
Loss = 5.8420e-04, PNorm = 106.9985, GNorm = 0.0692, lr_0 = 9.2868e-04
Validation auc = 0.660945
Epoch 1434
Validation auc = 0.660781
Epoch 1435
Validation auc = 0.661218
Epoch 1436
Validation auc = 0.661273
Epoch 1437
Validation auc = 0.661382
Epoch 1438
Loss = 1.7478e-04, PNorm = 107.0172, GNorm = 0.0053, lr_0 = 9.2845e-04
Loss = 3.4488e-05, PNorm = 107.0182, GNorm = 0.0015, lr_0 = 9.2844e-04
Validation auc = 0.661491
Epoch 1439
Validation auc = 0.657009
Epoch 1440
Validation auc = 0.652088
Epoch 1441
Validation auc = 0.650722
Epoch 1442
Validation auc = 0.648918
Epoch 1443
Loss = 3.6081e-03, PNorm = 107.0347, GNorm = 0.0642, lr_0 = 9.2822e-04
Validation auc = 0.647496
Epoch 1444
Validation auc = 0.647442
Epoch 1445
Validation auc = 0.647004
Epoch 1446
Validation auc = 0.647113
Epoch 1447
Validation auc = 0.647223
Epoch 1448
Loss = 1.6325e-04, PNorm = 107.0778, GNorm = 0.0044, lr_0 = 9.2798e-04
Validation auc = 0.646621
Epoch 1449
Validation auc = 0.646457
Epoch 1450
Validation auc = 0.647496
Epoch 1451
Validation auc = 0.648043
Epoch 1452
Loss = 7.6638e-05, PNorm = 107.1131, GNorm = 0.0021, lr_0 = 9.2776e-04
Loss = 2.4396e-05, PNorm = 107.1152, GNorm = 0.0010, lr_0 = 9.2775e-04
Validation auc = 0.649082
Epoch 1453
Validation auc = 0.648644
Epoch 1454
Validation auc = 0.648426
Epoch 1455
Validation auc = 0.647496
Epoch 1456
Validation auc = 0.643123
Epoch 1457
Loss = 1.5243e-02, PNorm = 107.1298, GNorm = 1.5427, lr_0 = 9.2752e-04
Loss = 8.5221e-04, PNorm = 107.1318, GNorm = 0.0325, lr_0 = 9.2750e-04
Validation auc = 0.640225
Epoch 1458
Validation auc = 0.638859
Epoch 1459
Validation auc = 0.638749
Epoch 1460
Validation auc = 0.640171
Epoch 1461
Validation auc = 0.641264
Epoch 1462
Loss = 6.1782e-05, PNorm = 107.1711, GNorm = 0.0019, lr_0 = 9.2729e-04
Validation auc = 0.641975
Epoch 1463
Validation auc = 0.642467
Epoch 1464
Validation auc = 0.643177
Epoch 1465
Validation auc = 0.643505
Epoch 1466
Loss = 8.9062e-05, PNorm = 107.1975, GNorm = 0.0004, lr_0 = 9.2706e-04
Validation auc = 0.643833
Epoch 1467
Validation auc = 0.644052
Epoch 1468
Validation auc = 0.644489
Epoch 1469
Validation auc = 0.644763
Epoch 1470
Validation auc = 0.644981
Epoch 1471
Loss = 1.4958e-05, PNorm = 107.2108, GNorm = 0.0009, lr_0 = 9.2683e-04
Loss = 1.0927e-06, PNorm = 107.2115, GNorm = 0.0000, lr_0 = 9.2681e-04
Validation auc = 0.645145
Epoch 1472
Validation auc = 0.653892
Epoch 1473
Validation auc = 0.661491
Epoch 1474
Validation auc = 0.666685
Epoch 1475
Validation auc = 0.668544
Epoch 1476
Loss = 4.3425e-02, PNorm = 107.2365, GNorm = 2.7838, lr_0 = 9.2660e-04
Validation auc = 0.659797
Epoch 1477
Validation auc = 0.654220
Epoch 1478
Validation auc = 0.650448
Epoch 1479
Validation auc = 0.649464
Epoch 1480
Validation auc = 0.656517
Epoch 1481
Loss = 7.6885e-05, PNorm = 107.3501, GNorm = 0.0018, lr_0 = 9.2635e-04
Validation auc = 0.662147
Epoch 1482
Validation auc = 0.666958
Epoch 1483
Validation auc = 0.667614
Epoch 1484
Validation auc = 0.657173
Epoch 1485
Loss = 2.6199e-02, PNorm = 107.4310, GNorm = 0.5917, lr_0 = 9.2614e-04
Loss = 3.6178e-02, PNorm = 107.4393, GNorm = 4.3070, lr_0 = 9.2612e-04
Validation auc = 0.640444
Epoch 1486
Validation auc = 0.634649
Epoch 1487
Validation auc = 0.610923
Epoch 1488
Validation auc = 0.594304
Epoch 1489
Validation auc = 0.595014
Epoch 1490
Loss = 6.7172e-04, PNorm = 107.6232, GNorm = 0.0280, lr_0 = 9.2589e-04
Loss = 7.4173e-05, PNorm = 107.6345, GNorm = 0.0038, lr_0 = 9.2587e-04
Validation auc = 0.595069
Epoch 1491
Validation auc = 0.595014
Epoch 1492
Validation auc = 0.596654
Epoch 1493
Validation auc = 0.593866
Epoch 1494
Validation auc = 0.592663
Epoch 1495
Loss = 4.9057e-04, PNorm = 107.7632, GNorm = 0.0094, lr_0 = 9.2566e-04
Validation auc = 0.585393
Epoch 1496
Validation auc = 0.579434
Epoch 1497
Validation auc = 0.575716
Epoch 1498
Validation auc = 0.573967
Epoch 1499
Loss = 8.1747e-04, PNorm = 107.8597, GNorm = 0.0110, lr_0 = 9.2543e-04
Validation auc = 0.573857
Epoch 1500
Validation auc = 0.572272
Epoch 1501
Validation auc = 0.573693
Epoch 1502
Validation auc = 0.596436
Epoch 1503
Validation auc = 0.617046
Epoch 1504
Loss = 4.8027e-04, PNorm = 107.9306, GNorm = 0.0121, lr_0 = 9.2520e-04
Loss = 1.1418e-03, PNorm = 107.9359, GNorm = 0.0480, lr_0 = 9.2518e-04
Validation auc = 0.629073
Epoch 1505
Validation auc = 0.637054
Epoch 1506
Validation auc = 0.640499
Epoch 1507
Validation auc = 0.642357
Epoch 1508
Validation auc = 0.644599
Epoch 1509
Loss = 4.1303e-04, PNorm = 107.9893, GNorm = 0.0332, lr_0 = 9.2497e-04
Validation auc = 0.646239
Epoch 1510
Validation auc = 0.647606
Epoch 1511
Validation auc = 0.643943
Epoch 1512
Validation auc = 0.641428
Epoch 1513
Validation auc = 0.638749
Epoch 1514
Loss = 7.5996e-05, PNorm = 108.0360, GNorm = 0.0029, lr_0 = 9.2472e-04
Validation auc = 0.636781
Epoch 1515
Validation auc = 0.635196
Epoch 1516
Validation auc = 0.633665
Epoch 1517
Validation auc = 0.632353
Epoch 1518
Loss = 1.8848e-03, PNorm = 108.0716, GNorm = 0.4547, lr_0 = 9.2451e-04
Loss = 7.7803e-02, PNorm = 108.0767, GNorm = 6.9650, lr_0 = 9.2449e-04
Validation auc = 0.629182
Epoch 1519
Validation auc = 0.611579
Epoch 1520
Validation auc = 0.625137
Epoch 1521
Validation auc = 0.646184
Epoch 1522
Validation auc = 0.648098
Epoch 1523
Loss = 7.2702e-03, PNorm = 108.1864, GNorm = 1.3390, lr_0 = 9.2427e-04
Loss = 5.1178e-04, PNorm = 108.1952, GNorm = 0.0253, lr_0 = 9.2425e-04
Validation auc = 0.653619
Epoch 1524
Validation auc = 0.657993
Epoch 1525
Validation auc = 0.654603
Epoch 1526
Validation auc = 0.650230
Epoch 1527
Validation auc = 0.651596
Epoch 1528
Loss = 1.7258e-03, PNorm = 108.2927, GNorm = 0.0459, lr_0 = 9.2404e-04
Validation auc = 0.650940
Epoch 1529
Validation auc = 0.648754
Epoch 1530
Validation auc = 0.647168
Epoch 1531
Validation auc = 0.645801
Epoch 1532
Validation auc = 0.640061
Epoch 1533
Loss = 6.7441e-04, PNorm = 108.3871, GNorm = 0.0181, lr_0 = 9.2379e-04
Validation auc = 0.633938
Epoch 1534
Validation auc = 0.629565
Epoch 1535
Validation auc = 0.627597
Epoch 1536
Validation auc = 0.625355
Epoch 1537
Loss = 7.5089e-03, PNorm = 108.4300, GNorm = 0.0093, lr_0 = 9.2358e-04
Loss = 1.6665e-04, PNorm = 108.4329, GNorm = 0.0065, lr_0 = 9.2356e-04
Validation auc = 0.625137
Epoch 1538
Validation auc = 0.625738
Epoch 1539
Validation auc = 0.625246
Epoch 1540
Validation auc = 0.624754
Epoch 1541
Validation auc = 0.624863
Epoch 1542
Loss = 9.2613e-04, PNorm = 108.4614, GNorm = 0.0382, lr_0 = 9.2335e-04
Validation auc = 0.624590
Epoch 1543
Validation auc = 0.624535
Epoch 1544
Validation auc = 0.624754
Epoch 1545
Validation auc = 0.625027
Epoch 1546
Validation auc = 0.624863
Epoch 1547
Loss = 1.2234e-04, PNorm = 108.4816, GNorm = 0.0030, lr_0 = 9.2310e-04
Validation auc = 0.624918
Epoch 1548
Validation auc = 0.624590
Epoch 1549
Validation auc = 0.624207
Epoch 1550
Validation auc = 0.624863
Epoch 1551
Loss = 4.0877e-04, PNorm = 108.4925, GNorm = 0.0118, lr_0 = 9.2289e-04
Loss = 3.3574e-05, PNorm = 108.4933, GNorm = 0.0018, lr_0 = 9.2287e-04
Validation auc = 0.625847
Epoch 1552
Validation auc = 0.626722
Epoch 1553
Validation auc = 0.627323
Epoch 1554
Validation auc = 0.627323
Epoch 1555
Validation auc = 0.627378
Epoch 1556
Loss = 1.9385e-03, PNorm = 108.5021, GNorm = 0.0126, lr_0 = 9.2264e-04
Loss = 5.9910e-04, PNorm = 108.5029, GNorm = 0.0212, lr_0 = 9.2263e-04
Validation auc = 0.628253
Epoch 1557
Validation auc = 0.628854
Epoch 1558
Validation auc = 0.629073
Epoch 1559
Validation auc = 0.629182
Epoch 1560
Validation auc = 0.629784
Epoch 1561
Loss = 4.2982e-05, PNorm = 108.5138, GNorm = 0.0013, lr_0 = 9.2242e-04
Validation auc = 0.629838
Epoch 1562
Validation auc = 0.630330
Epoch 1563
Validation auc = 0.630494
Epoch 1564
Validation auc = 0.630549
Epoch 1565
Validation auc = 0.630822
Epoch 1566
Loss = 4.0441e-04, PNorm = 108.5210, GNorm = 0.0131, lr_0 = 9.2217e-04
Validation auc = 0.631041
Epoch 1567
Validation auc = 0.631533
Epoch 1568
Validation auc = 0.632517
Epoch 1569
Validation auc = 0.632900
Epoch 1570
Loss = 2.8211e-05, PNorm = 108.5283, GNorm = 0.0009, lr_0 = 9.2196e-04
Loss = 0.0000e+00, PNorm = 108.5287, GNorm = 0.0000, lr_0 = 9.2194e-04
Validation auc = 0.632736
Epoch 1571
Validation auc = 0.632790
Epoch 1572
Validation auc = 0.633337
Epoch 1573
Validation auc = 0.632408
Epoch 1574
Validation auc = 0.631478
Epoch 1575
Loss = 1.4580e-03, PNorm = 108.5335, GNorm = 0.1412, lr_0 = 9.2173e-04
Validation auc = 0.630002
Epoch 1576
Validation auc = 0.628799
Epoch 1577
Validation auc = 0.627597
Epoch 1578
Validation auc = 0.627925
Epoch 1579
Validation auc = 0.628799
Epoch 1580
Loss = 1.2594e-04, PNorm = 108.5488, GNorm = 0.0029, lr_0 = 9.2148e-04
Validation auc = 0.628854
Epoch 1581
Validation auc = 0.628909
Epoch 1582
Validation auc = 0.628745
Epoch 1583
Validation auc = 0.629073
Epoch 1584
Loss = 2.3586e-04, PNorm = 108.5584, GNorm = 0.0085, lr_0 = 9.2127e-04
Loss = 4.9922e-05, PNorm = 108.5589, GNorm = 0.0026, lr_0 = 9.2125e-04
Validation auc = 0.629237
Epoch 1585
Validation auc = 0.628963
Epoch 1586
Validation auc = 0.629073
Epoch 1587
Validation auc = 0.629237
Epoch 1588
Validation auc = 0.629346
Epoch 1589
Loss = 1.3805e-04, PNorm = 108.5643, GNorm = 0.0070, lr_0 = 9.2103e-04
Loss = 3.9454e-04, PNorm = 108.5647, GNorm = 0.0193, lr_0 = 9.2101e-04
Validation auc = 0.629346
Epoch 1590
Validation auc = 0.629565
Epoch 1591
Validation auc = 0.629620
Epoch 1592
Validation auc = 0.629565
Epoch 1593
Validation auc = 0.629620
Epoch 1594
Loss = 5.2554e-05, PNorm = 108.5692, GNorm = 0.0015, lr_0 = 9.2080e-04
Validation auc = 0.629620
Epoch 1595
Validation auc = 0.629893
Epoch 1596
Validation auc = 0.629784
Epoch 1597
Validation auc = 0.629674
Epoch 1598
Validation auc = 0.629729
Epoch 1599
Loss = 6.7121e-05, PNorm = 108.5732, GNorm = 0.0020, lr_0 = 9.2055e-04
Validation auc = 0.629729
Epoch 1600
Validation auc = 0.629784
Epoch 1601
Validation auc = 0.630002
Epoch 1602
Validation auc = 0.631260
Epoch 1603
Loss = 5.9950e-05, PNorm = 108.5760, GNorm = 0.0023, lr_0 = 9.2034e-04
Loss = 5.5067e-05, PNorm = 108.5763, GNorm = 0.0027, lr_0 = 9.2032e-04
Validation auc = 0.631588
Epoch 1604
Validation auc = 0.632134
Epoch 1605
Validation auc = 0.632790
Epoch 1606
Validation auc = 0.632353
Epoch 1607
Validation auc = 0.632408
Epoch 1608
Loss = 3.6808e-04, PNorm = 108.5827, GNorm = 0.0056, lr_0 = 9.2010e-04
Validation auc = 0.632845
Epoch 1609
Validation auc = 0.632845
Epoch 1610
Validation auc = 0.632736
Epoch 1611
Validation auc = 0.632517
Epoch 1612
Validation auc = 0.632681
Epoch 1613
Loss = 3.3206e-05, PNorm = 108.5896, GNorm = 0.0012, lr_0 = 9.1987e-04
Validation auc = 0.632736
Epoch 1614
Validation auc = 0.632736
Epoch 1615
Validation auc = 0.632189
Epoch 1616
Validation auc = 0.632025
Epoch 1617
Loss = 8.5846e-05, PNorm = 108.5960, GNorm = 0.0047, lr_0 = 9.1966e-04
Loss = 6.8544e-06, PNorm = 108.5964, GNorm = 0.0004, lr_0 = 9.1964e-04
Validation auc = 0.632298
Epoch 1618
Validation auc = 0.633173
Epoch 1619
Validation auc = 0.634212
Epoch 1620
Validation auc = 0.634813
Epoch 1621
Validation auc = 0.634813
Epoch 1622
Loss = 5.5301e-04, PNorm = 108.6027, GNorm = 0.1029, lr_0 = 9.1941e-04
Loss = 4.7684e-07, PNorm = 108.6032, GNorm = 0.0000, lr_0 = 9.1939e-04
Validation auc = 0.635032
Epoch 1623
Validation auc = 0.635086
Epoch 1624
Validation auc = 0.635086
Epoch 1625
Validation auc = 0.634922
Epoch 1626
Validation auc = 0.634922
Epoch 1627
Loss = 6.8786e-05, PNorm = 108.6089, GNorm = 0.0026, lr_0 = 9.1918e-04
Validation auc = 0.634868
Epoch 1628
Validation auc = 0.634758
Epoch 1629
Validation auc = 0.634922
Epoch 1630
Validation auc = 0.635141
Epoch 1631
Validation auc = 0.635032
Epoch 1632
Loss = 9.9917e-06, PNorm = 108.6148, GNorm = 0.0004, lr_0 = 9.1894e-04
Validation auc = 0.633884
Epoch 1633
Validation auc = 0.633884
Epoch 1634
Validation auc = 0.634212
Epoch 1635
Validation auc = 0.634102
Epoch 1636
Loss = 3.4149e-05, PNorm = 108.6228, GNorm = 0.0017, lr_0 = 9.1873e-04
Loss = 1.1875e-04, PNorm = 108.6233, GNorm = 0.0131, lr_0 = 9.1871e-04
Validation auc = 0.634212
Epoch 1637
Validation auc = 0.633993
Epoch 1638
Validation auc = 0.633556
Epoch 1639
Validation auc = 0.633501
Epoch 1640
Validation auc = 0.633610
Epoch 1641
Loss = 1.5879e-04, PNorm = 108.6292, GNorm = 0.0138, lr_0 = 9.1848e-04
Validation auc = 0.633774
Epoch 1642
Validation auc = 0.633829
Epoch 1643
Validation auc = 0.633774
Epoch 1644
Validation auc = 0.633829
Epoch 1645
Validation auc = 0.633829
Epoch 1646
Loss = 4.1539e-05, PNorm = 108.6343, GNorm = 0.0013, lr_0 = 9.1825e-04
Validation auc = 0.633884
Epoch 1647
Validation auc = 0.633446
Epoch 1648
Validation auc = 0.633501
Epoch 1649
Validation auc = 0.633282
Epoch 1650
Loss = 2.3026e-05, PNorm = 108.6399, GNorm = 0.0011, lr_0 = 9.1804e-04
Loss = 1.2139e-05, PNorm = 108.6403, GNorm = 0.0007, lr_0 = 9.1803e-04
Validation auc = 0.633337
Epoch 1651
Validation auc = 0.633556
Epoch 1652
Validation auc = 0.633720
Epoch 1653
Validation auc = 0.633501
Epoch 1654
Validation auc = 0.633501
Epoch 1655
Loss = 2.1530e-05, PNorm = 108.6449, GNorm = 0.0007, lr_0 = 9.1780e-04
Loss = 4.5413e-05, PNorm = 108.6451, GNorm = 0.0028, lr_0 = 9.1778e-04
Validation auc = 0.633446
Epoch 1656
Validation auc = 0.633337
Epoch 1657
Validation auc = 0.633337
Epoch 1658
Validation auc = 0.633610
Epoch 1659
Validation auc = 0.633610
Epoch 1660
Loss = 1.8943e-05, PNorm = 108.6483, GNorm = 0.0007, lr_0 = 9.1757e-04
Validation auc = 0.633720
Epoch 1661
Validation auc = 0.633720
Epoch 1662
Validation auc = 0.633665
Epoch 1663
Validation auc = 0.633720
Epoch 1664
Validation auc = 0.633829
Epoch 1665
Loss = 5.1425e-06, PNorm = 108.6503, GNorm = 0.0002, lr_0 = 9.1733e-04
Validation auc = 0.633829
Epoch 1666
Validation auc = 0.633829
Epoch 1667
Validation auc = 0.633774
Epoch 1668
Validation auc = 0.633774
Epoch 1669
Loss = 8.6068e-05, PNorm = 108.6520, GNorm = 0.0002, lr_0 = 9.1712e-04
Loss = 1.0133e-06, PNorm = 108.6521, GNorm = 0.0001, lr_0 = 9.1710e-04
Validation auc = 0.633665
Epoch 1670
Validation auc = 0.633720
Epoch 1671
Validation auc = 0.633610
Epoch 1672
Validation auc = 0.633556
Epoch 1673
Validation auc = 0.633556
Epoch 1674
Loss = 3.0369e-05, PNorm = 108.6544, GNorm = 0.0004, lr_0 = 9.1687e-04
Validation auc = 0.633556
Epoch 1675
Validation auc = 0.633610
Epoch 1676
Validation auc = 0.633556
Epoch 1677
Validation auc = 0.633501
Epoch 1678
Validation auc = 0.633501
Epoch 1679
Loss = 1.1772e-05, PNorm = 108.6568, GNorm = 0.0004, lr_0 = 9.1664e-04
Validation auc = 0.633392
Epoch 1680
Validation auc = 0.633501
Epoch 1681
Validation auc = 0.633446
Epoch 1682
Validation auc = 0.633556
Epoch 1683
Loss = 1.8873e-05, PNorm = 108.6585, GNorm = 0.0000, lr_0 = 9.1642e-04
Validation auc = 0.633556
Epoch 1684
Validation auc = 0.633556
Epoch 1685
Validation auc = 0.633446
Epoch 1686
Validation auc = 0.633446
Epoch 1687
Validation auc = 0.633446
Epoch 1688
Loss = 5.1894e-05, PNorm = 108.6600, GNorm = 0.0030, lr_0 = 9.1619e-04
Loss = 5.3644e-07, PNorm = 108.6601, GNorm = 0.0000, lr_0 = 9.1617e-04
Validation auc = 0.633446
Epoch 1689
Validation auc = 0.633337
Epoch 1690
Validation auc = 0.633337
Epoch 1691
Validation auc = 0.633228
Epoch 1692
Validation auc = 0.633228
Epoch 1693
Loss = 4.1317e-06, PNorm = 108.6613, GNorm = 0.0001, lr_0 = 9.1596e-04
Validation auc = 0.633173
Epoch 1694
Validation auc = 0.633173
Epoch 1695
Validation auc = 0.633337
Epoch 1696
Validation auc = 0.633228
Epoch 1697
Validation auc = 0.633228
Epoch 1698
Loss = 6.0819e-06, PNorm = 108.6635, GNorm = 0.0003, lr_0 = 9.1572e-04
Validation auc = 0.633282
Epoch 1699
Validation auc = 0.633282
Epoch 1700
Validation auc = 0.633337
Epoch 1701
Validation auc = 0.633228
Epoch 1702
Loss = 5.2446e-05, PNorm = 108.6660, GNorm = 0.0109, lr_0 = 9.1551e-04
Loss = 4.3710e-06, PNorm = 108.6663, GNorm = 0.0002, lr_0 = 9.1549e-04
Validation auc = 0.633282
Epoch 1703
Validation auc = 0.633282
Epoch 1704
Validation auc = 0.633228
Epoch 1705
Validation auc = 0.633392
Epoch 1706
Validation auc = 0.633501
Epoch 1707
Loss = 3.6839e-05, PNorm = 108.6696, GNorm = 0.0022, lr_0 = 9.1526e-04
Loss = 1.9868e-08, PNorm = 108.6698, GNorm = 0.0000, lr_0 = 9.1525e-04
Validation auc = 0.633446
Epoch 1708
Validation auc = 0.633446
Epoch 1709
Validation auc = 0.633392
Epoch 1710
Validation auc = 0.633337
Epoch 1711
Validation auc = 0.633282
Epoch 1712
Loss = 2.1291e-06, PNorm = 108.6720, GNorm = 0.0001, lr_0 = 9.1504e-04
Validation auc = 0.633228
Epoch 1713
Validation auc = 0.633173
Epoch 1714
Validation auc = 0.633118
Epoch 1715
Validation auc = 0.633064
Epoch 1716
Loss = 1.2067e-05, PNorm = 108.6736, GNorm = 0.0004, lr_0 = 9.1481e-04
Validation auc = 0.633064
Epoch 1717
Validation auc = 0.633118
Epoch 1718
Validation auc = 0.633118
Epoch 1719
Validation auc = 0.633118
Epoch 1720
Validation auc = 0.633118
Epoch 1721
Loss = 9.3238e-06, PNorm = 108.6749, GNorm = 0.0005, lr_0 = 9.1458e-04
Loss = 0.0000e+00, PNorm = 108.6750, GNorm = 0.0000, lr_0 = 9.1457e-04
Validation auc = 0.633173
Epoch 1722
Validation auc = 0.633228
Epoch 1723
Validation auc = 0.633556
Epoch 1724
Validation auc = 0.633938
Epoch 1725
Validation auc = 0.633665
Epoch 1726
Loss = 2.6629e-05, PNorm = 108.6761, GNorm = 0.0008, lr_0 = 9.1436e-04
Validation auc = 0.634321
Epoch 1727
Validation auc = 0.634485
Epoch 1728
Validation auc = 0.634376
Epoch 1729
Validation auc = 0.634376
Epoch 1730
Validation auc = 0.634266
Epoch 1731
Loss = 2.0796e-05, PNorm = 108.6792, GNorm = 0.0013, lr_0 = 9.1411e-04
Validation auc = 0.634321
Epoch 1732
Validation auc = 0.634376
Epoch 1733
Validation auc = 0.634321
Epoch 1734
Validation auc = 0.634266
Epoch 1735
Loss = 1.0908e-05, PNorm = 108.6825, GNorm = 0.0004, lr_0 = 9.1390e-04
Loss = 2.1656e-06, PNorm = 108.6827, GNorm = 0.0002, lr_0 = 9.1389e-04
Validation auc = 0.634212
Epoch 1736
Validation auc = 0.634157
Epoch 1737
Validation auc = 0.634048
Epoch 1738
Validation auc = 0.633993
Epoch 1739
Validation auc = 0.633993
Epoch 1740
Loss = 1.4904e-05, PNorm = 108.6856, GNorm = 0.0007, lr_0 = 9.1366e-04
Loss = 1.1702e-05, PNorm = 108.6858, GNorm = 0.0008, lr_0 = 9.1364e-04
Validation auc = 0.634048
Epoch 1741
Validation auc = 0.633938
Epoch 1742
Validation auc = 0.633884
Epoch 1743
Validation auc = 0.633774
Epoch 1744
Validation auc = 0.633829
Epoch 1745
Loss = 2.6625e-05, PNorm = 108.6889, GNorm = 0.0017, lr_0 = 9.1343e-04
Validation auc = 0.633884
Epoch 1746
Validation auc = 0.633665
Epoch 1747
Validation auc = 0.633774
Epoch 1748
Validation auc = 0.633938
Epoch 1749
Loss = 8.3636e-06, PNorm = 108.6917, GNorm = 0.0002, lr_0 = 9.1320e-04
Validation auc = 0.634102
Epoch 1750
Validation auc = 0.633993
Epoch 1751
Validation auc = 0.633993
Epoch 1752
Validation auc = 0.633993
Epoch 1753
Validation auc = 0.633993
Epoch 1754
Loss = 8.3701e-06, PNorm = 108.6941, GNorm = 0.0005, lr_0 = 9.1298e-04
Loss = 5.9206e-06, PNorm = 108.6943, GNorm = 0.0006, lr_0 = 9.1296e-04
Validation auc = 0.633993
Epoch 1755
Validation auc = 0.634157
Epoch 1756
Validation auc = 0.634321
Epoch 1757
Validation auc = 0.634266
Epoch 1758
Validation auc = 0.634266
Epoch 1759
Loss = 7.1802e-06, PNorm = 108.6968, GNorm = 0.0004, lr_0 = 9.1275e-04
Validation auc = 0.634157
Epoch 1760
Validation auc = 0.634157
Epoch 1761
Validation auc = 0.634157
Epoch 1762
Validation auc = 0.634212
Epoch 1763
Validation auc = 0.634266
Epoch 1764
Loss = 1.2429e-05, PNorm = 108.6997, GNorm = 0.0011, lr_0 = 9.1251e-04
Validation auc = 0.634212
Epoch 1765
Validation auc = 0.634266
Epoch 1766
Validation auc = 0.634266
Epoch 1767
Validation auc = 0.634157
Epoch 1768
Loss = 9.4498e-06, PNorm = 108.7025, GNorm = 0.0000, lr_0 = 9.1230e-04
Loss = 7.7486e-07, PNorm = 108.7027, GNorm = 0.0001, lr_0 = 9.1228e-04
Validation auc = 0.633884
Epoch 1769
Validation auc = 0.633829
Epoch 1770
Validation auc = 0.634048
Epoch 1771
Validation auc = 0.634048
Epoch 1772
Validation auc = 0.633720
Epoch 1773
Loss = 1.3816e-06, PNorm = 108.7042, GNorm = 0.0000, lr_0 = 9.1206e-04
Loss = 1.0530e-06, PNorm = 108.7043, GNorm = 0.0001, lr_0 = 9.1204e-04
Validation auc = 0.633446
Epoch 1774
Validation auc = 0.633337
Epoch 1775
Validation auc = 0.633282
Epoch 1776
Validation auc = 0.633446
Epoch 1777
Validation auc = 0.633173
Epoch 1778
Loss = 3.3878e-06, PNorm = 108.7057, GNorm = 0.0001, lr_0 = 9.1183e-04
Validation auc = 0.633173
Epoch 1779
Validation auc = 0.633064
Epoch 1780
Validation auc = 0.633064
Epoch 1781
Validation auc = 0.633173
Epoch 1782
Validation auc = 0.633118
Epoch 1783
Loss = 1.4006e-05, PNorm = 108.7077, GNorm = 0.0005, lr_0 = 9.1159e-04
Validation auc = 0.633064
Epoch 1784
Validation auc = 0.633064
Epoch 1785
Validation auc = 0.633173
Epoch 1786
Validation auc = 0.633173
Epoch 1787
Loss = 3.3284e-05, PNorm = 108.7103, GNorm = 0.0001, lr_0 = 9.1138e-04
Loss = 6.1591e-07, PNorm = 108.7106, GNorm = 0.0000, lr_0 = 9.1136e-04
Validation auc = 0.633009
Epoch 1788
Validation auc = 0.633064
Epoch 1789
Validation auc = 0.633009
Epoch 1790
Validation auc = 0.632954
Epoch 1791
Validation auc = 0.633064
Epoch 1792
Loss = 2.2577e-06, PNorm = 108.7129, GNorm = 0.0001, lr_0 = 9.1115e-04
Validation auc = 0.633064
Epoch 1793
Validation auc = 0.633173
Epoch 1794
Validation auc = 0.633064
Epoch 1795
Validation auc = 0.632954
Epoch 1796
Validation auc = 0.632900
Epoch 1797
Loss = 1.1765e-05, PNorm = 108.7180, GNorm = 0.0004, lr_0 = 9.1091e-04
Validation auc = 0.632954
Epoch 1798
Validation auc = 0.632954
Epoch 1799
Validation auc = 0.632845
Epoch 1800
Validation auc = 0.632900
Epoch 1801
Loss = 1.8966e-06, PNorm = 108.7215, GNorm = 0.0001, lr_0 = 9.1070e-04
Loss = 7.9473e-08, PNorm = 108.7216, GNorm = 0.0000, lr_0 = 9.1068e-04
Validation auc = 0.632790
Epoch 1802
Validation auc = 0.632845
Epoch 1803
Validation auc = 0.632845
Epoch 1804
Validation auc = 0.632845
Epoch 1805
Validation auc = 0.632845
Epoch 1806
Loss = 2.3889e-06, PNorm = 108.7238, GNorm = 0.0001, lr_0 = 9.1046e-04
Loss = 9.5367e-07, PNorm = 108.7239, GNorm = 0.0001, lr_0 = 9.1044e-04
Validation auc = 0.632790
Epoch 1807
Validation auc = 0.632790
Epoch 1808
Validation auc = 0.632790
Epoch 1809
Validation auc = 0.632845
Epoch 1810
Validation auc = 0.632736
Epoch 1811
Loss = 7.1833e-06, PNorm = 108.7257, GNorm = 0.0003, lr_0 = 9.1023e-04
Validation auc = 0.632736
Epoch 1812
Validation auc = 0.632790
Epoch 1813
Validation auc = 0.632845
Epoch 1814
Validation auc = 0.632900
Epoch 1815
Validation auc = 0.632900
Epoch 1816
Loss = 6.9856e-07, PNorm = 108.7288, GNorm = 0.0000, lr_0 = 9.0999e-04
Validation auc = 0.632954
Epoch 1817
Validation auc = 0.633009
Epoch 1818
Validation auc = 0.632900
Epoch 1819
Validation auc = 0.632626
Epoch 1820
Loss = 1.6439e-06, PNorm = 108.7309, GNorm = 0.0001, lr_0 = 9.0978e-04
Loss = 2.5829e-07, PNorm = 108.7310, GNorm = 0.0000, lr_0 = 9.0976e-04
Validation auc = 0.632626
Epoch 1821
Validation auc = 0.632626
Epoch 1822
Validation auc = 0.632626
Epoch 1823
Validation auc = 0.632517
Epoch 1824
Validation auc = 0.632517
Epoch 1825
Loss = 4.6730e-07, PNorm = 108.7323, GNorm = 0.0000, lr_0 = 9.0955e-04
Validation auc = 0.632462
Epoch 1826
Validation auc = 0.632408
Epoch 1827
Validation auc = 0.632353
Epoch 1828
Validation auc = 0.632462
Epoch 1829
Validation auc = 0.632517
Epoch 1830
Loss = 5.8433e-06, PNorm = 108.7338, GNorm = 0.0002, lr_0 = 9.0931e-04
Validation auc = 0.632462
Epoch 1831
Validation auc = 0.632462
Epoch 1832
Validation auc = 0.632462
Epoch 1833
Validation auc = 0.632462
Epoch 1834
Loss = 1.6343e-06, PNorm = 108.7349, GNorm = 0.0000, lr_0 = 9.0910e-04
Loss = 1.2517e-06, PNorm = 108.7350, GNorm = 0.0001, lr_0 = 9.0909e-04
Validation auc = 0.632462
Epoch 1835
Validation auc = 0.632462
Epoch 1836
Validation auc = 0.632462
Epoch 1837
Validation auc = 0.632462
Epoch 1838
Validation auc = 0.632462
Epoch 1839
Loss = 1.6075e-05, PNorm = 108.7359, GNorm = 0.0002, lr_0 = 9.0886e-04
Loss = 3.9736e-08, PNorm = 108.7360, GNorm = 0.0000, lr_0 = 9.0884e-04
Validation auc = 0.632462
Epoch 1840
Validation auc = 0.632408
Epoch 1841
Validation auc = 0.632462
Epoch 1842
Validation auc = 0.632462
Epoch 1843
Validation auc = 0.632572
Epoch 1844
Loss = 4.8431e-05, PNorm = 108.7369, GNorm = 0.0014, lr_0 = 9.0863e-04
Validation auc = 0.632626
Epoch 1845
Validation auc = 0.632626
Epoch 1846
Validation auc = 0.632626
Epoch 1847
Validation auc = 0.632572
Epoch 1848
Validation auc = 0.632572
Epoch 1849
Loss = 6.0320e-07, PNorm = 108.7382, GNorm = 0.0000, lr_0 = 9.0839e-04
Validation auc = 0.632572
Epoch 1850
Validation auc = 0.632572
Epoch 1851
Validation auc = 0.632572
Epoch 1852
Validation auc = 0.632572
Epoch 1853
Loss = 6.9588e-06, PNorm = 108.7393, GNorm = 0.0001, lr_0 = 9.0818e-04
Loss = 6.9539e-07, PNorm = 108.7394, GNorm = 0.0001, lr_0 = 9.0817e-04
Validation auc = 0.632599
Epoch 1854
Validation auc = 0.632626
Epoch 1855
Validation auc = 0.632626
Epoch 1856
Validation auc = 0.632626
Epoch 1857
Validation auc = 0.632626
Epoch 1858
Loss = 1.5127e-06, PNorm = 108.7411, GNorm = 0.0001, lr_0 = 9.0794e-04
Validation auc = 0.632626
Epoch 1859
Validation auc = 0.632517
Epoch 1860
Validation auc = 0.632517
Epoch 1861
Validation auc = 0.632517
Epoch 1862
Validation auc = 0.632954
Epoch 1863
Loss = 5.4309e-06, PNorm = 108.7411, GNorm = 0.0002, lr_0 = 9.0772e-04
Validation auc = 0.633228
Epoch 1864
Validation auc = 0.633118
Epoch 1865
Validation auc = 0.633337
Epoch 1866
Validation auc = 0.633282
Epoch 1867
Loss = 1.5127e-06, PNorm = 108.7403, GNorm = 0.0001, lr_0 = 9.0751e-04
Loss = 2.0663e-06, PNorm = 108.7403, GNorm = 0.0001, lr_0 = 9.0749e-04
Validation auc = 0.633282
Epoch 1868
Validation auc = 0.633282
Epoch 1869
Validation auc = 0.633282
Epoch 1870
Validation auc = 0.633282
Epoch 1871
Validation auc = 0.633392
Epoch 1872
Loss = 1.3780e-06, PNorm = 108.7424, GNorm = 0.0001, lr_0 = 9.0727e-04
Loss = 1.6093e-06, PNorm = 108.7427, GNorm = 0.0001, lr_0 = 9.0725e-04
Validation auc = 0.633446
Epoch 1873
Validation auc = 0.633337
Epoch 1874
Validation auc = 0.633337
Epoch 1875
Validation auc = 0.633282
Epoch 1876
Validation auc = 0.633228
Epoch 1877
Loss = 1.3542e-06, PNorm = 108.7456, GNorm = 0.0001, lr_0 = 9.0704e-04
Validation auc = 0.633009
Epoch 1878
Validation auc = 0.633009
Epoch 1879
Validation auc = 0.633118
Epoch 1880
Validation auc = 0.633173
Epoch 1881
Validation auc = 0.633173
Epoch 1882
Loss = 9.6682e-05, PNorm = 108.7482, GNorm = 0.0123, lr_0 = 9.0680e-04
Validation auc = 0.633173
Epoch 1883
Validation auc = 0.633228
Epoch 1884
Validation auc = 0.633392
Epoch 1885
Validation auc = 0.633392
Epoch 1886
Loss = 1.5747e-06, PNorm = 108.7491, GNorm = 0.0000, lr_0 = 9.0659e-04
Loss = 1.8477e-06, PNorm = 108.7491, GNorm = 0.0001, lr_0 = 9.0657e-04
Validation auc = 0.633392
Epoch 1887
Validation auc = 0.633392
Epoch 1888
Validation auc = 0.633392
Epoch 1889
Validation auc = 0.633392
Epoch 1890
Validation auc = 0.633392
Epoch 1891
Loss = 1.9431e-06, PNorm = 108.7500, GNorm = 0.0000, lr_0 = 9.0635e-04
Validation auc = 0.633392
Epoch 1892
Validation auc = 0.633446
Epoch 1893
Validation auc = 0.633501
Epoch 1894
Validation auc = 0.633501
Epoch 1895
Validation auc = 0.633501
Epoch 1896
Loss = 7.3909e-07, PNorm = 108.7507, GNorm = 0.0000, lr_0 = 9.0612e-04
Validation auc = 0.633501
Epoch 1897
Validation auc = 0.633446
Epoch 1898
Validation auc = 0.633501
Epoch 1899
Validation auc = 0.633446
Epoch 1900
Loss = 2.2458e-06, PNorm = 108.7513, GNorm = 0.0001, lr_0 = 9.0592e-04
Loss = 1.9868e-08, PNorm = 108.7514, GNorm = 0.0000, lr_0 = 9.0590e-04
Validation auc = 0.633446
Epoch 1901
Validation auc = 0.633337
Epoch 1902
Validation auc = 0.633282
Epoch 1903
Validation auc = 0.633282
Epoch 1904
Validation auc = 0.633282
Epoch 1905
Loss = 7.0214e-07, PNorm = 108.7522, GNorm = 0.0000, lr_0 = 9.0567e-04
Loss = 5.9605e-08, PNorm = 108.7522, GNorm = 0.0000, lr_0 = 9.0566e-04
Validation auc = 0.633282
Epoch 1906
Validation auc = 0.633282
Epoch 1907
Validation auc = 0.633282
Epoch 1908
Validation auc = 0.633392
Epoch 1909
Validation auc = 0.633392
Epoch 1910
Loss = 2.3579e-06, PNorm = 108.7528, GNorm = 0.0001, lr_0 = 9.0545e-04
Validation auc = 0.633392
Epoch 1911
Validation auc = 0.633392
Epoch 1912
Validation auc = 0.633446
Epoch 1913
Validation auc = 0.633501
Epoch 1914
Validation auc = 0.633556
Epoch 1915
Loss = 9.9181e-07, PNorm = 108.7537, GNorm = 0.0000, lr_0 = 9.0521e-04
Validation auc = 0.633556
Epoch 1916
Validation auc = 0.633556
Epoch 1917
Validation auc = 0.633501
Epoch 1918
Validation auc = 0.633501
Epoch 1919
Loss = 4.6134e-07, PNorm = 108.7543, GNorm = 0.0000, lr_0 = 9.0500e-04
Loss = 1.1921e-07, PNorm = 108.7543, GNorm = 0.0000, lr_0 = 9.0498e-04
Validation auc = 0.633556
Epoch 1920
Validation auc = 0.633556
Epoch 1921
Validation auc = 0.633556
Epoch 1922
Validation auc = 0.633501
Epoch 1923
Validation auc = 0.633501
Epoch 1924
Loss = 2.3603e-06, PNorm = 108.7547, GNorm = 0.0001, lr_0 = 9.0476e-04
Validation auc = 0.633446
Epoch 1925
Validation auc = 0.633446
Epoch 1926
Validation auc = 0.633446
Epoch 1927
Validation auc = 0.633446
Epoch 1928
Validation auc = 0.633446
Epoch 1929
Loss = 1.0347e-06, PNorm = 108.7553, GNorm = 0.0000, lr_0 = 9.0454e-04
Validation auc = 0.633392
Epoch 1930
Validation auc = 0.633392
Epoch 1931
Validation auc = 0.633392
Epoch 1932
Validation auc = 0.633337
Epoch 1933
Loss = 5.4995e-07, PNorm = 108.7557, GNorm = 0.0000, lr_0 = 9.0431e-04
Validation auc = 0.633337
Epoch 1934
Validation auc = 0.633282
Epoch 1935
Validation auc = 0.633282
Epoch 1936
Validation auc = 0.633446
Epoch 1937
Validation auc = 0.633446
Epoch 1938
Loss = 6.8306e-07, PNorm = 108.7564, GNorm = 0.0000, lr_0 = 9.0409e-04
Loss = 1.5895e-07, PNorm = 108.7565, GNorm = 0.0000, lr_0 = 9.0407e-04
Validation auc = 0.633446
Epoch 1939
Validation auc = 0.633392
Epoch 1940
Validation auc = 0.633446
Epoch 1941
Validation auc = 0.633392
Epoch 1942
Validation auc = 0.633392
Epoch 1943
Loss = 1.4067e-07, PNorm = 108.7571, GNorm = 0.0000, lr_0 = 9.0386e-04
Validation auc = 0.633392
Epoch 1944
Validation auc = 0.633392
Epoch 1945
Validation auc = 0.633337
Epoch 1946
Validation auc = 0.633337
Epoch 1947
Validation auc = 0.633337
Epoch 1948
Loss = 3.2186e-07, PNorm = 108.7579, GNorm = 0.0000, lr_0 = 9.0362e-04
Validation auc = 0.633282
Epoch 1949
Validation auc = 0.633282
Epoch 1950
Validation auc = 0.633282
Epoch 1951
Validation auc = 0.633282
Epoch 1952
Loss = 3.8466e-06, PNorm = 108.7585, GNorm = 0.0003, lr_0 = 9.0341e-04
Loss = 3.5763e-07, PNorm = 108.7586, GNorm = 0.0000, lr_0 = 9.0340e-04
Validation auc = 0.633282
Epoch 1953
Validation auc = 0.633337
Epoch 1954
Validation auc = 0.633282
Epoch 1955
Validation auc = 0.633282
Epoch 1956
Validation auc = 0.633282
Epoch 1957
Loss = 3.1673e-06, PNorm = 108.7592, GNorm = 0.0001, lr_0 = 9.0317e-04
Loss = 0.0000e+00, PNorm = 108.7592, GNorm = 0.0000, lr_0 = 9.0316e-04
Validation auc = 0.633337
Epoch 1958
Validation auc = 0.633392
Epoch 1959
Validation auc = 0.633501
Epoch 1960
Validation auc = 0.633501
Epoch 1961
Validation auc = 0.633446
Epoch 1962
Loss = 9.8465e-07, PNorm = 108.7607, GNorm = 0.0001, lr_0 = 9.0295e-04
Validation auc = 0.633282
Epoch 1963
Validation auc = 0.633282
Epoch 1964
Validation auc = 0.633282
Epoch 1965
Validation auc = 0.633337
Epoch 1966
Loss = 3.5021e-07, PNorm = 108.7616, GNorm = 0.0000, lr_0 = 9.0273e-04
Validation auc = 0.633337
Epoch 1967
Validation auc = 0.633446
Epoch 1968
Validation auc = 0.633446
Epoch 1969
Validation auc = 0.633446
Epoch 1970
Validation auc = 0.633446
Epoch 1971
Loss = 6.0200e-07, PNorm = 108.7621, GNorm = 0.0000, lr_0 = 9.0250e-04
Loss = 1.9868e-07, PNorm = 108.7621, GNorm = 0.0000, lr_0 = 9.0249e-04
Validation auc = 0.633446
Epoch 1972
Validation auc = 0.633446
Epoch 1973
Validation auc = 0.633446
Epoch 1974
Validation auc = 0.633501
Epoch 1975
Validation auc = 0.633446
Epoch 1976
Loss = 6.4134e-07, PNorm = 108.7625, GNorm = 0.0000, lr_0 = 9.0228e-04
Validation auc = 0.633446
Epoch 1977
Validation auc = 0.633337
Epoch 1978
Validation auc = 0.633556
Epoch 1979
Validation auc = 0.633829
Epoch 1980
Validation auc = 0.633774
Epoch 1981
Loss = 3.2686e-06, PNorm = 108.7656, GNorm = 0.0002, lr_0 = 9.0204e-04
Validation auc = 0.633610
Epoch 1982
Validation auc = 0.634266
Epoch 1983
Validation auc = 0.634868
Epoch 1984
Validation auc = 0.634868
Epoch 1985
Loss = 2.5903e-06, PNorm = 108.7728, GNorm = 0.0000, lr_0 = 9.0183e-04
Loss = 3.5763e-07, PNorm = 108.7732, GNorm = 0.0000, lr_0 = 9.0181e-04
Validation auc = 0.635032
Epoch 1986
Validation auc = 0.635086
Epoch 1987
Validation auc = 0.635086
Epoch 1988
Validation auc = 0.635141
Epoch 1989
Validation auc = 0.635086
Epoch 1990
Loss = 2.2648e-06, PNorm = 108.7765, GNorm = 0.0000, lr_0 = 9.0159e-04
Loss = 1.9868e-08, PNorm = 108.7767, GNorm = 0.0000, lr_0 = 9.0157e-04
Validation auc = 0.634977
Epoch 1991
Validation auc = 0.635086
Epoch 1992
Validation auc = 0.635141
Epoch 1993
Validation auc = 0.635141
Epoch 1994
Validation auc = 0.635141
Epoch 1995
Loss = 1.8406e-05, PNorm = 108.7777, GNorm = 0.0007, lr_0 = 9.0137e-04
Validation auc = 0.635141
Epoch 1996
Validation auc = 0.635196
Epoch 1997
Validation auc = 0.635196
Epoch 1998
Validation auc = 0.635196
Epoch 1999
Loss = 2.2346e-06, PNorm = 108.7785, GNorm = 0.0000, lr_0 = 9.0114e-04
Validation auc = 0.635196
Model 0 best validation auc = 0.719331 on epoch 8
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.585859
Ensemble test auc = 0.585859
Fold 5
Splitting data with seed 5
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.488684
Epoch 1
Validation auc = 0.690411
Epoch 2
Validation auc = 0.681773
Epoch 3
Validation auc = 0.718073
Epoch 4
Loss = 6.9212e-01, PNorm = 71.6147, GNorm = 1.7610, lr_0 = 2.0385e-04
Loss = 7.9432e-01, PNorm = 71.6159, GNorm = 2.6076, lr_0 = 2.1077e-04
Validation auc = 0.673682
Epoch 5
Validation auc = 0.655860
Epoch 6
Validation auc = 0.701181
Epoch 7
Validation auc = 0.681992
Epoch 8
Validation auc = 0.636016
Epoch 9
Loss = 7.1462e-01, PNorm = 71.6388, GNorm = 1.1399, lr_0 = 3.0077e-04
Validation auc = 0.639351
Epoch 10
Validation auc = 0.668270
Epoch 11
Validation auc = 0.698174
Epoch 12
Validation auc = 0.712388
Epoch 13
Validation auc = 0.727367
Epoch 14
Loss = 7.1880e-01, PNorm = 71.6825, GNorm = 0.9396, lr_0 = 4.0462e-04
Validation auc = 0.705336
Epoch 15
Validation auc = 0.728242
Epoch 16
Validation auc = 0.694293
Epoch 17
Validation auc = 0.689919
Epoch 18
Loss = 6.7020e-01, PNorm = 71.7338, GNorm = 0.5200, lr_0 = 4.9462e-04
Loss = 5.3167e-01, PNorm = 71.7387, GNorm = 2.0150, lr_0 = 5.0154e-04
Validation auc = 0.686202
Epoch 19
Validation auc = 0.637492
Epoch 20
Validation auc = 0.665646
Epoch 21
Validation auc = 0.621638
Epoch 22
Validation auc = 0.665646
Epoch 23
Loss = 6.8391e-01, PNorm = 71.8181, GNorm = 0.6689, lr_0 = 5.9846e-04
Loss = 6.4461e-01, PNorm = 71.8257, GNorm = 1.2520, lr_0 = 6.0538e-04
Validation auc = 0.638913
Epoch 24
Validation auc = 0.641100
Epoch 25
Validation auc = 0.641537
Epoch 26
Validation auc = 0.640991
Epoch 27
Validation auc = 0.678548
Epoch 28
Loss = 1.2322e+00, PNorm = 71.9198, GNorm = 6.9404, lr_0 = 6.9538e-04
Validation auc = 0.628417
Epoch 29
Validation auc = 0.625519
Epoch 30
Validation auc = 0.637437
Epoch 31
Validation auc = 0.619287
Epoch 32
Validation auc = 0.598677
Epoch 33
Loss = 6.7735e-01, PNorm = 72.0530, GNorm = 0.2404, lr_0 = 7.9923e-04
Validation auc = 0.580144
Epoch 34
Validation auc = 0.608189
Epoch 35
Validation auc = 0.626503
Epoch 36
Validation auc = 0.631478
Epoch 37
Loss = 6.2800e-01, PNorm = 72.2015, GNorm = 0.3413, lr_0 = 8.8923e-04
Loss = 5.2348e-01, PNorm = 72.2144, GNorm = 1.6384, lr_0 = 8.9615e-04
Validation auc = 0.646457
Epoch 38
Validation auc = 0.647824
Epoch 39
Validation auc = 0.636726
Epoch 40
Validation auc = 0.610376
Epoch 41
Validation auc = 0.587415
Epoch 42
Loss = 6.9257e-01, PNorm = 72.3731, GNorm = 0.1967, lr_0 = 9.8615e-04
Validation auc = 0.590422
Epoch 43
Validation auc = 0.581347
Epoch 44
Validation auc = 0.576755
Epoch 45
Validation auc = 0.585830
Epoch 46
Validation auc = 0.586213
Epoch 47
Loss = 5.9542e-01, PNorm = 72.6218, GNorm = 0.5077, lr_0 = 9.9977e-04
Validation auc = 0.587415
Epoch 48
Validation auc = 0.604964
Epoch 49
Validation auc = 0.601684
Epoch 50
Validation auc = 0.592882
Epoch 51
Loss = 6.3895e-01, PNorm = 72.8043, GNorm = 0.3280, lr_0 = 9.9954e-04
Loss = 7.3494e-01, PNorm = 72.8177, GNorm = 0.4927, lr_0 = 9.9952e-04
Validation auc = 0.581456
Epoch 52
Validation auc = 0.575443
Epoch 53
Validation auc = 0.565438
Epoch 54
Validation auc = 0.583206
Epoch 55
Validation auc = 0.573311
Epoch 56
Loss = 5.7693e-01, PNorm = 73.0169, GNorm = 0.8721, lr_0 = 9.9927e-04
Loss = 8.6024e-01, PNorm = 73.0260, GNorm = 3.4040, lr_0 = 9.9926e-04
Validation auc = 0.558496
Epoch 57
Validation auc = 0.536573
Epoch 58
Validation auc = 0.553794
Epoch 59
Validation auc = 0.563689
Epoch 60
Validation auc = 0.573311
Epoch 61
Loss = 5.7063e-01, PNorm = 73.1990, GNorm = 0.3009, lr_0 = 9.9903e-04
Validation auc = 0.574349
Epoch 62
Validation auc = 0.575825
Epoch 63
Validation auc = 0.575661
Epoch 64
Validation auc = 0.581347
Epoch 65
Validation auc = 0.558168
Epoch 66
Loss = 6.3010e-01, PNorm = 73.3730, GNorm = 0.5864, lr_0 = 9.9876e-04
Validation auc = 0.554505
Epoch 67
Validation auc = 0.587962
Epoch 68
Validation auc = 0.592773
Epoch 69
Validation auc = 0.581675
Epoch 70
Loss = 5.4502e-01, PNorm = 73.5516, GNorm = 0.8798, lr_0 = 9.9853e-04
Loss = 7.5113e-01, PNorm = 73.5672, GNorm = 0.8144, lr_0 = 9.9851e-04
Validation auc = 0.577739
Epoch 71
Validation auc = 0.569375
Epoch 72
Validation auc = 0.574349
Epoch 73
Validation auc = 0.549803
Epoch 74
Validation auc = 0.555434
Epoch 75
Loss = 5.7481e-01, PNorm = 73.7424, GNorm = 0.2310, lr_0 = 9.9828e-04
Validation auc = 0.568992
Epoch 76
Validation auc = 0.584846
Epoch 77
Validation auc = 0.594085
Epoch 78
Validation auc = 0.612454
Epoch 79
Validation auc = 0.605620
Epoch 80
Loss = 5.6219e-01, PNorm = 73.9426, GNorm = 0.4819, lr_0 = 9.9802e-04
Validation auc = 0.596873
Epoch 81
Validation auc = 0.590969
Epoch 82
Validation auc = 0.577630
Epoch 83
Validation auc = 0.583752
Epoch 84
Loss = 4.8163e-01, PNorm = 74.1387, GNorm = 1.1816, lr_0 = 9.9779e-04
Loss = 7.9956e-01, PNorm = 74.1554, GNorm = 0.7947, lr_0 = 9.9777e-04
Validation auc = 0.587798
Epoch 85
Validation auc = 0.599989
Epoch 86
Validation auc = 0.638913
Epoch 87
Validation auc = 0.652034
Epoch 88
Validation auc = 0.653455
Epoch 89
Loss = 5.2387e-01, PNorm = 74.3973, GNorm = 0.4907, lr_0 = 9.9752e-04
Loss = 4.9869e-01, PNorm = 74.4144, GNorm = 1.9021, lr_0 = 9.9750e-04
Validation auc = 0.654767
Epoch 90
Validation auc = 0.663186
Epoch 91
Validation auc = 0.658102
Epoch 92
Validation auc = 0.531817
Epoch 93
Validation auc = 0.680243
Epoch 94
Loss = 6.9302e-01, PNorm = 74.6932, GNorm = 0.3202, lr_0 = 9.9727e-04
Validation auc = 0.589875
Epoch 95
Validation auc = 0.623005
Epoch 96
Validation auc = 0.413459
Epoch 97
Validation auc = 0.450579
Epoch 98
Validation auc = 0.329434
Epoch 99
Loss = 1.3090e+00, PNorm = 75.0828, GNorm = 11.4694, lr_0 = 9.9701e-04
Validation auc = 0.563470
Epoch 100
Validation auc = 0.595834
Epoch 101
Validation auc = 0.707194
Epoch 102
Validation auc = 0.628034
Epoch 103
Loss = 6.7166e-01, PNorm = 75.3483, GNorm = 0.2707, lr_0 = 9.9678e-04
Loss = 7.2466e-01, PNorm = 75.3660, GNorm = 0.7230, lr_0 = 9.9676e-04
Validation auc = 0.619178
Epoch 104
Validation auc = 0.633064
Epoch 105
Validation auc = 0.618904
Epoch 106
Validation auc = 0.617538
Epoch 107
Validation auc = 0.587743
Epoch 108
Loss = 6.7422e-01, PNorm = 75.5961, GNorm = 0.6594, lr_0 = 9.9651e-04
Validation auc = 0.619014
Epoch 109
Validation auc = 0.645036
Epoch 110
Validation auc = 0.632900
Epoch 111
Validation auc = 0.644927
Epoch 112
Validation auc = 0.640553
Epoch 113
Loss = 5.7552e-01, PNorm = 75.8395, GNorm = 0.6079, lr_0 = 9.9627e-04
Validation auc = 0.635852
Epoch 114
Validation auc = 0.628854
Epoch 115
Validation auc = 0.610485
Epoch 116
Validation auc = 0.578996
Epoch 117
Loss = 5.1052e-01, PNorm = 76.0918, GNorm = 2.8670, lr_0 = 9.9604e-04
Loss = 5.9496e-01, PNorm = 76.1059, GNorm = 1.8713, lr_0 = 9.9602e-04
Validation auc = 0.573912
Epoch 118
Validation auc = 0.585393
Epoch 119
Validation auc = 0.606495
Epoch 120
Validation auc = 0.611962
Epoch 121
Validation auc = 0.630877
Epoch 122
Loss = 4.8821e-01, PNorm = 76.4079, GNorm = 5.1594, lr_0 = 9.9577e-04
Loss = 8.4686e-01, PNorm = 76.4205, GNorm = 1.8343, lr_0 = 9.9575e-04
Validation auc = 0.671550
Epoch 123
Validation auc = 0.643560
Epoch 124
Validation auc = 0.642467
Epoch 125
Validation auc = 0.643451
Epoch 126
Validation auc = 0.634704
Epoch 127
Loss = 7.1902e-01, PNorm = 76.7149, GNorm = 3.8337, lr_0 = 9.9552e-04
Validation auc = 0.631697
Epoch 128
Validation auc = 0.637218
Epoch 129
Validation auc = 0.641428
Epoch 130
Validation auc = 0.640061
Epoch 131
Validation auc = 0.631642
Epoch 132
Loss = 3.9226e-01, PNorm = 77.0061, GNorm = 1.8490, lr_0 = 9.9526e-04
Validation auc = 0.629948
Epoch 133
Validation auc = 0.618030
Epoch 134
Validation auc = 0.616499
Epoch 135
Validation auc = 0.631916
Epoch 136
Loss = 4.3014e-01, PNorm = 77.2912, GNorm = 1.6589, lr_0 = 9.9503e-04
Loss = 5.5127e-01, PNorm = 77.3183, GNorm = 3.5951, lr_0 = 9.9501e-04
Validation auc = 0.643833
Epoch 137
Validation auc = 0.624371
Epoch 138
Validation auc = 0.608244
Epoch 139
Validation auc = 0.585065
Epoch 140
Validation auc = 0.586486
Epoch 141
Loss = 4.3143e-01, PNorm = 77.6891, GNorm = 1.8113, lr_0 = 9.9477e-04
Validation auc = 0.603816
Epoch 142
Validation auc = 0.602996
Epoch 143
Validation auc = 0.606385
Epoch 144
Validation auc = 0.605073
Epoch 145
Validation auc = 0.598841
Epoch 146
Loss = 2.7756e-01, PNorm = 78.0756, GNorm = 1.0826, lr_0 = 9.9452e-04
Validation auc = 0.598076
Epoch 147
Validation auc = 0.611852
Epoch 148
Validation auc = 0.637382
Epoch 149
Validation auc = 0.672589
Epoch 150
Loss = 3.6448e-01, PNorm = 78.3387, GNorm = 0.7242, lr_0 = 9.9429e-04
Loss = 1.6932e-01, PNorm = 78.3610, GNorm = 1.3349, lr_0 = 9.9427e-04
Validation auc = 0.665099
Epoch 151
Validation auc = 0.663186
Epoch 152
Validation auc = 0.652799
Epoch 153
Validation auc = 0.653838
Epoch 154
Validation auc = 0.671496
Epoch 155
Loss = 2.4350e-01, PNorm = 78.6574, GNorm = 0.8522, lr_0 = 9.9403e-04
Loss = 3.1950e-01, PNorm = 78.6778, GNorm = 3.0944, lr_0 = 9.9401e-04
Validation auc = 0.671714
Epoch 156
Validation auc = 0.661983
Epoch 157
Validation auc = 0.644325
Epoch 158
Validation auc = 0.629291
Epoch 159
Validation auc = 0.637492
Epoch 160
Loss = 3.7579e-01, PNorm = 78.9161, GNorm = 2.2138, lr_0 = 9.9378e-04
Validation auc = 0.625082
Epoch 161
Validation auc = 0.619342
Epoch 162
Validation auc = 0.613656
Epoch 163
Validation auc = 0.606768
Epoch 164
Validation auc = 0.622622
Epoch 165
Loss = 3.4301e-01, PNorm = 79.2280, GNorm = 2.1827, lr_0 = 9.9351e-04
Validation auc = 0.644161
Epoch 166
Validation auc = 0.631970
Epoch 167
Validation auc = 0.637820
Epoch 168
Validation auc = 0.652854
Epoch 169
Loss = 2.2692e-01, PNorm = 79.5444, GNorm = 0.9464, lr_0 = 9.9329e-04
Loss = 5.9543e-02, PNorm = 79.5778, GNorm = 0.4434, lr_0 = 9.9327e-04
Validation auc = 0.638366
Epoch 170
Validation auc = 0.646293
Epoch 171
Validation auc = 0.655532
Epoch 172
Validation auc = 0.657555
Epoch 173
Validation auc = 0.660343
Epoch 174
Loss = 2.2907e-01, PNorm = 79.9257, GNorm = 1.2583, lr_0 = 9.9302e-04
Validation auc = 0.657610
Epoch 175
Validation auc = 0.646949
Epoch 176
Validation auc = 0.652799
Epoch 177
Validation auc = 0.661491
Epoch 178
Validation auc = 0.669746
Epoch 179
Loss = 2.8272e-01, PNorm = 80.1767, GNorm = 4.5471, lr_0 = 9.9277e-04
Validation auc = 0.673682
Epoch 180
Validation auc = 0.662967
Epoch 181
Validation auc = 0.681828
Epoch 182
Validation auc = 0.667560
Epoch 183
Loss = 2.5620e-01, PNorm = 80.4636, GNorm = 0.7567, lr_0 = 9.9253e-04
Validation auc = 0.675596
Epoch 184
Validation auc = 0.658266
Epoch 185
Validation auc = 0.656571
Epoch 186
Validation auc = 0.658266
Epoch 187
Validation auc = 0.658211
Epoch 188
Loss = 1.7184e-01, PNorm = 80.7501, GNorm = 0.6985, lr_0 = 9.9228e-04
Loss = 2.4702e-01, PNorm = 80.7675, GNorm = 7.0053, lr_0 = 9.9226e-04
Validation auc = 0.658430
Epoch 189
Validation auc = 0.660398
Epoch 190
Validation auc = 0.659359
Epoch 191
Validation auc = 0.663459
Epoch 192
Validation auc = 0.675268
Epoch 193
Loss = 1.7537e-01, PNorm = 81.0129, GNorm = 0.5875, lr_0 = 9.9204e-04
Validation auc = 0.692106
Epoch 194
Validation auc = 0.687951
Epoch 195
Validation auc = 0.674776
Epoch 196
Validation auc = 0.665865
Epoch 197
Validation auc = 0.685874
Epoch 198
Loss = 1.3778e-01, PNorm = 81.2814, GNorm = 0.7067, lr_0 = 9.9177e-04
Validation auc = 0.687131
Epoch 199
Validation auc = 0.678384
Epoch 200
Validation auc = 0.665482
Epoch 201
Validation auc = 0.633665
Epoch 202
Loss = 4.8844e-01, PNorm = 81.4715, GNorm = 4.2199, lr_0 = 9.9154e-04
Loss = 2.9081e-01, PNorm = 81.4890, GNorm = 2.1861, lr_0 = 9.9153e-04
Validation auc = 0.597201
Epoch 203
Validation auc = 0.628854
Epoch 204
Validation auc = 0.659687
Epoch 205
Validation auc = 0.665264
Epoch 206
Validation auc = 0.681063
Epoch 207
Loss = 1.5227e-01, PNorm = 81.7344, GNorm = 1.0705, lr_0 = 9.9128e-04
Loss = 9.5252e-02, PNorm = 81.7545, GNorm = 0.6164, lr_0 = 9.9126e-04
Validation auc = 0.703696
Epoch 208
Validation auc = 0.708069
Epoch 209
Validation auc = 0.698775
Epoch 210
Validation auc = 0.730702
Epoch 211
Validation auc = 0.752624
Epoch 212
Loss = 1.5479e-01, PNorm = 81.9617, GNorm = 1.1318, lr_0 = 9.9103e-04
Validation auc = 0.754811
Epoch 213
Validation auc = 0.748524
Epoch 214
Validation auc = 0.745025
Epoch 215
Validation auc = 0.749617
Epoch 216
Loss = 1.0143e-01, PNorm = 82.2032, GNorm = 0.2672, lr_0 = 9.9079e-04
Validation auc = 0.741308
Epoch 217
Validation auc = 0.724688
Epoch 218
Validation auc = 0.711021
Epoch 219
Validation auc = 0.711513
Epoch 220
Validation auc = 0.715121
Epoch 221
Loss = 2.9826e-01, PNorm = 82.4354, GNorm = 1.6547, lr_0 = 9.9054e-04
Loss = 1.0972e-01, PNorm = 82.4546, GNorm = 4.4565, lr_0 = 9.9052e-04
Validation auc = 0.709381
Epoch 222
Validation auc = 0.675377
Epoch 223
Validation auc = 0.668052
Epoch 224
Validation auc = 0.676443
Epoch 225
Validation auc = 0.692489
Epoch 226
Loss = 9.8582e-02, PNorm = 82.7217, GNorm = 0.6971, lr_0 = 9.9030e-04
Validation auc = 0.715559
Epoch 227
Validation auc = 0.742073
Epoch 228
Validation auc = 0.728406
Epoch 229
Validation auc = 0.711295
Epoch 230
Validation auc = 0.674831
Epoch 231
Loss = 2.4630e-01, PNorm = 83.0428, GNorm = 5.0370, lr_0 = 9.9003e-04
Validation auc = 0.681063
Epoch 232
Validation auc = 0.670894
Epoch 233
Validation auc = 0.651979
Epoch 234
Validation auc = 0.651378
Epoch 235
Loss = 9.5217e-02, PNorm = 83.2762, GNorm = 0.7502, lr_0 = 9.8980e-04
Loss = 5.8013e-02, PNorm = 83.2929, GNorm = 2.4545, lr_0 = 9.8979e-04
Validation auc = 0.647934
Epoch 236
Validation auc = 0.625191
Epoch 237
Validation auc = 0.641592
Epoch 238
Validation auc = 0.645473
Epoch 239
Validation auc = 0.646348
Epoch 240
Loss = 2.3790e-01, PNorm = 83.4861, GNorm = 2.3101, lr_0 = 9.8954e-04
Loss = 1.7853e-02, PNorm = 83.4983, GNorm = 0.3374, lr_0 = 9.8952e-04
Validation auc = 0.673518
Epoch 241
Validation auc = 0.697955
Epoch 242
Validation auc = 0.702493
Epoch 243
Validation auc = 0.690848
Epoch 244
Validation auc = 0.681063
Epoch 245
Loss = 1.2499e-01, PNorm = 83.6516, GNorm = 0.8586, lr_0 = 9.8930e-04
Validation auc = 0.680953
Epoch 246
Validation auc = 0.703422
Epoch 247
Validation auc = 0.681992
Epoch 248
Validation auc = 0.638804
Epoch 249
Loss = 1.1003e-01, PNorm = 83.8308, GNorm = 1.4638, lr_0 = 9.8905e-04
Validation auc = 0.622677
Epoch 250
Validation auc = 0.619014
Epoch 251
Validation auc = 0.618412
Epoch 252
Validation auc = 0.616936
Epoch 253
Validation auc = 0.615187
Epoch 254
Loss = 1.4363e-01, PNorm = 84.0458, GNorm = 0.9224, lr_0 = 9.8880e-04
Loss = 1.4596e-03, PNorm = 84.0583, GNorm = 0.0408, lr_0 = 9.8879e-04
Validation auc = 0.620435
Epoch 255
Validation auc = 0.633173
Epoch 256
Validation auc = 0.644380
Epoch 257
Validation auc = 0.650339
Epoch 258
Validation auc = 0.670894
Epoch 259
Loss = 9.1908e-02, PNorm = 84.1949, GNorm = 0.9604, lr_0 = 9.8856e-04
Validation auc = 0.683140
Epoch 260
Validation auc = 0.696534
Epoch 261
Validation auc = 0.710803
Epoch 262
Validation auc = 0.713044
Epoch 263
Validation auc = 0.718948
Epoch 264
Loss = 9.7078e-02, PNorm = 84.4038, GNorm = 1.0134, lr_0 = 9.8830e-04
Validation auc = 0.721080
Epoch 265
Validation auc = 0.714903
Epoch 266
Validation auc = 0.695331
Epoch 267
Validation auc = 0.691832
Epoch 268
Loss = 8.3089e-02, PNorm = 84.6229, GNorm = 0.3524, lr_0 = 9.8807e-04
Loss = 3.6224e-01, PNorm = 84.6375, GNorm = 5.4793, lr_0 = 9.8805e-04
Validation auc = 0.699923
Epoch 269
Validation auc = 0.694839
Epoch 270
Validation auc = 0.683523
Epoch 271
Validation auc = 0.673081
Epoch 272
Validation auc = 0.664443
Epoch 273
Loss = 1.5012e-01, PNorm = 84.8469, GNorm = 1.3569, lr_0 = 9.8781e-04
Loss = 3.7143e-02, PNorm = 84.8614, GNorm = 0.6677, lr_0 = 9.8779e-04
Validation auc = 0.664935
Epoch 274
Validation auc = 0.664881
Epoch 275
Validation auc = 0.656079
Epoch 276
Validation auc = 0.649246
Epoch 277
Validation auc = 0.645747
Epoch 278
Loss = 5.5269e-02, PNorm = 85.0328, GNorm = 0.6808, lr_0 = 9.8756e-04
Validation auc = 0.647660
Epoch 279
Validation auc = 0.655751
Epoch 280
Validation auc = 0.659195
Epoch 281
Validation auc = 0.657993
Epoch 282
Validation auc = 0.658375
Epoch 283
Loss = 1.9082e-02, PNorm = 85.1857, GNorm = 0.2944, lr_0 = 9.8730e-04
Validation auc = 0.661819
Epoch 284
Validation auc = 0.665974
Epoch 285
Validation auc = 0.675815
Epoch 286
Validation auc = 0.681281
Epoch 287
Loss = 1.0822e-01, PNorm = 85.2881, GNorm = 0.8681, lr_0 = 9.8707e-04
Loss = 4.7097e-02, PNorm = 85.2958, GNorm = 3.3354, lr_0 = 9.8705e-04
Validation auc = 0.670840
Epoch 288
Validation auc = 0.658867
Epoch 289
Validation auc = 0.675104
Epoch 290
Validation auc = 0.682703
Epoch 291
Validation auc = 0.686202
Epoch 292
Loss = 1.1819e-01, PNorm = 85.3954, GNorm = 1.9571, lr_0 = 9.8683e-04
Validation auc = 0.690302
Epoch 293
Validation auc = 0.694566
Epoch 294
Validation auc = 0.698393
Epoch 295
Validation auc = 0.699158
Epoch 296
Validation auc = 0.699158
Epoch 297
Loss = 1.1690e-02, PNorm = 85.4696, GNorm = 0.1145, lr_0 = 9.8656e-04
Validation auc = 0.699486
Epoch 298
Validation auc = 0.691286
Epoch 299
Validation auc = 0.679204
Epoch 300
Validation auc = 0.700798
Epoch 301
Loss = 1.7861e-01, PNorm = 85.5209, GNorm = 0.3942, lr_0 = 9.8634e-04
Loss = 8.4276e-03, PNorm = 85.5258, GNorm = 0.1103, lr_0 = 9.8632e-04
Validation auc = 0.718839
Epoch 302
Validation auc = 0.735513
Epoch 303
Validation auc = 0.733818
Epoch 304
Validation auc = 0.729554
Epoch 305
Validation auc = 0.723267
Epoch 306
Loss = 6.5191e-02, PNorm = 85.6162, GNorm = 0.4071, lr_0 = 9.8607e-04
Loss = 1.0363e-01, PNorm = 85.6260, GNorm = 3.4385, lr_0 = 9.8606e-04
Validation auc = 0.712989
Epoch 307
Validation auc = 0.705937
Epoch 308
Validation auc = 0.704078
Epoch 309
Validation auc = 0.704898
Epoch 310
Validation auc = 0.705172
Epoch 311
Loss = 5.1565e-02, PNorm = 85.7421, GNorm = 1.1921, lr_0 = 9.8583e-04
Validation auc = 0.703040
Epoch 312
Validation auc = 0.701673
Epoch 313
Validation auc = 0.698666
Epoch 314
Validation auc = 0.696589
Epoch 315
Validation auc = 0.694839
Epoch 316
Loss = 1.0557e-02, PNorm = 85.8374, GNorm = 0.2201, lr_0 = 9.8557e-04
Validation auc = 0.694785
Epoch 317
Validation auc = 0.693855
Epoch 318
Validation auc = 0.695277
Epoch 319
Validation auc = 0.694785
Epoch 320
Loss = 7.5243e-03, PNorm = 85.8766, GNorm = 0.2546, lr_0 = 9.8534e-04
Loss = 4.5920e-03, PNorm = 85.8799, GNorm = 0.1153, lr_0 = 9.8532e-04
Validation auc = 0.695331
Epoch 321
Validation auc = 0.695441
Epoch 322
Validation auc = 0.693910
Epoch 323
Validation auc = 0.693801
Epoch 324
Validation auc = 0.693637
Epoch 325
Loss = 7.2622e-03, PNorm = 85.9301, GNorm = 0.2081, lr_0 = 9.8509e-04
Validation auc = 0.697081
Epoch 326
Validation auc = 0.703641
Epoch 327
Validation auc = 0.708944
Epoch 328
Validation auc = 0.714028
Epoch 329
Validation auc = 0.718073
Epoch 330
Loss = 9.1780e-03, PNorm = 85.9822, GNorm = 0.3800, lr_0 = 9.8483e-04
Validation auc = 0.720206
Epoch 331
Validation auc = 0.721190
Epoch 332
Validation auc = 0.720862
Epoch 333
Validation auc = 0.719167
Epoch 334
Loss = 1.0487e-01, PNorm = 86.0217, GNorm = 1.0109, lr_0 = 9.8461e-04
Loss = 1.1728e-03, PNorm = 86.0246, GNorm = 0.0277, lr_0 = 9.8459e-04
Validation auc = 0.719714
Epoch 335
Validation auc = 0.720752
Epoch 336
Validation auc = 0.721736
Epoch 337
Validation auc = 0.723322
Epoch 338
Validation auc = 0.712443
Epoch 339
Loss = 8.5230e-02, PNorm = 86.0689, GNorm = 0.0922, lr_0 = 9.8434e-04
Loss = 1.4904e-03, PNorm = 86.0723, GNorm = 0.0415, lr_0 = 9.8433e-04
Validation auc = 0.697463
Epoch 340
Validation auc = 0.695058
Epoch 341
Validation auc = 0.694675
Epoch 342
Validation auc = 0.694293
Epoch 343
Validation auc = 0.694949
Epoch 344
Loss = 1.1157e-02, PNorm = 86.1143, GNorm = 0.6041, lr_0 = 9.8410e-04
Validation auc = 0.693637
Epoch 345
Validation auc = 0.688716
Epoch 346
Validation auc = 0.684288
Epoch 347
Validation auc = 0.682265
Epoch 348
Validation auc = 0.683796
Epoch 349
Loss = 1.1897e-01, PNorm = 86.1439, GNorm = 0.7847, lr_0 = 9.8384e-04
Validation auc = 0.681445
Epoch 350
Validation auc = 0.682101
Epoch 351
Validation auc = 0.682320
Epoch 352
Validation auc = 0.686639
Epoch 353
Loss = 7.8256e-02, PNorm = 86.1898, GNorm = 1.8523, lr_0 = 9.8361e-04
Loss = 7.6956e-03, PNorm = 86.1984, GNorm = 0.2820, lr_0 = 9.8359e-04
Validation auc = 0.697081
Epoch 354
Validation auc = 0.703969
Epoch 355
Validation auc = 0.699705
Epoch 356
Validation auc = 0.702165
Epoch 357
Validation auc = 0.709053
Epoch 358
Loss = 5.9861e-02, PNorm = 86.3831, GNorm = 1.2932, lr_0 = 9.8335e-04
Validation auc = 0.712005
Epoch 359
Validation auc = 0.729171
Epoch 360
Validation auc = 0.723704
Epoch 361
Validation auc = 0.731413
Epoch 362
Validation auc = 0.739121
Epoch 363
Loss = 7.5112e-02, PNorm = 86.6838, GNorm = 1.2337, lr_0 = 9.8311e-04
Validation auc = 0.730538
Epoch 364
Validation auc = 0.726930
Epoch 365
Validation auc = 0.724798
Epoch 366
Validation auc = 0.722010
Epoch 367
Loss = 3.4486e-02, PNorm = 86.9011, GNorm = 1.2594, lr_0 = 9.8288e-04
Loss = 4.6008e-03, PNorm = 86.9146, GNorm = 0.0883, lr_0 = 9.8286e-04
Validation auc = 0.715941
Epoch 368
Validation auc = 0.709326
Epoch 369
Validation auc = 0.715559
Epoch 370
Validation auc = 0.728789
Epoch 371
Validation auc = 0.743385
Epoch 372
Loss = 2.0304e-01, PNorm = 87.0941, GNorm = 1.7525, lr_0 = 9.8262e-04
Loss = 1.3450e-01, PNorm = 87.1107, GNorm = 2.2680, lr_0 = 9.8260e-04
Validation auc = 0.734310
Epoch 373
Validation auc = 0.716980
Epoch 374
Validation auc = 0.698666
Epoch 375
Validation auc = 0.678056
Epoch 376
Validation auc = 0.676033
Epoch 377
Loss = 5.1517e-02, PNorm = 87.3393, GNorm = 1.1031, lr_0 = 9.8237e-04
Validation auc = 0.682484
Epoch 378
Validation auc = 0.673901
Epoch 379
Validation auc = 0.673682
Epoch 380
Validation auc = 0.673956
Epoch 381
Validation auc = 0.677455
Epoch 382
Loss = 1.4023e-02, PNorm = 87.5769, GNorm = 0.1287, lr_0 = 9.8211e-04
Validation auc = 0.693855
Epoch 383
Validation auc = 0.699650
Epoch 384
Validation auc = 0.703422
Epoch 385
Validation auc = 0.702821
Epoch 386
Loss = 5.8383e-02, PNorm = 87.7920, GNorm = 0.5499, lr_0 = 9.8189e-04
Loss = 4.2636e-02, PNorm = 87.8082, GNorm = 0.4812, lr_0 = 9.8187e-04
Validation auc = 0.702548
Epoch 387
Validation auc = 0.703204
Epoch 388
Validation auc = 0.704461
Epoch 389
Validation auc = 0.708889
Epoch 390
Validation auc = 0.708342
Epoch 391
Loss = 1.5900e-02, PNorm = 87.9941, GNorm = 0.3205, lr_0 = 9.8163e-04
Validation auc = 0.703422
Epoch 392
Validation auc = 0.698502
Epoch 393
Validation auc = 0.693527
Epoch 394
Validation auc = 0.691914
Epoch 395
Validation auc = 0.700689
Epoch 396
Loss = 3.4121e-02, PNorm = 88.1515, GNorm = 0.6310, lr_0 = 9.8138e-04
Validation auc = 0.707905
Epoch 397
Validation auc = 0.710256
Epoch 398
Validation auc = 0.720206
Epoch 399
Validation auc = 0.723814
Epoch 400
Loss = 7.1561e-02, PNorm = 88.2706, GNorm = 0.8554, lr_0 = 9.8116e-04
Loss = 1.4550e-01, PNorm = 88.2777, GNorm = 3.4272, lr_0 = 9.8114e-04
Validation auc = 0.718073
Epoch 401
Validation auc = 0.715395
Epoch 402
Validation auc = 0.710420
Epoch 403
Validation auc = 0.705664
Epoch 404
Validation auc = 0.701181
Epoch 405
Loss = 1.1213e-01, PNorm = 88.3710, GNorm = 2.1056, lr_0 = 9.8089e-04
Loss = 8.5798e-04, PNorm = 88.3744, GNorm = 0.0202, lr_0 = 9.8088e-04
Validation auc = 0.703586
Epoch 406
Validation auc = 0.707194
Epoch 407
Validation auc = 0.713372
Epoch 408
Validation auc = 0.717909
Epoch 409
Validation auc = 0.719222
Epoch 410
Loss = 9.8700e-02, PNorm = 88.4439, GNorm = 0.8721, lr_0 = 9.8065e-04
Validation auc = 0.726110
Epoch 411
Validation auc = 0.732342
Epoch 412
Validation auc = 0.737754
Epoch 413
Validation auc = 0.740324
Epoch 414
Validation auc = 0.743658
Epoch 415
Loss = 2.9201e-03, PNorm = 88.5172, GNorm = 0.0836, lr_0 = 9.8039e-04
Validation auc = 0.745134
Epoch 416
Validation auc = 0.719331
Epoch 417
Validation auc = 0.708124
Epoch 418
Validation auc = 0.729937
Epoch 419
Loss = 8.2701e-02, PNorm = 88.6610, GNorm = 1.9967, lr_0 = 9.8016e-04
Loss = 6.6257e-02, PNorm = 88.6813, GNorm = 2.3123, lr_0 = 9.8015e-04
Validation auc = 0.737536
Epoch 420
Validation auc = 0.737809
Epoch 421
Validation auc = 0.732451
Epoch 422
Validation auc = 0.722775
Epoch 423
Validation auc = 0.712989
Epoch 424
Loss = 3.4719e-02, PNorm = 88.9582, GNorm = 0.2034, lr_0 = 9.7990e-04
Validation auc = 0.702384
Epoch 425
Validation auc = 0.699322
Epoch 426
Validation auc = 0.698502
Epoch 427
Validation auc = 0.698393
Epoch 428
Validation auc = 0.701892
Epoch 429
Loss = 1.0922e-02, PNorm = 89.1694, GNorm = 0.1173, lr_0 = 9.7966e-04
Validation auc = 0.704461
Epoch 430
Validation auc = 0.701946
Epoch 431
Validation auc = 0.697791
Epoch 432
Validation auc = 0.694293
Epoch 433
Loss = 8.3937e-03, PNorm = 89.2907, GNorm = 0.1476, lr_0 = 9.7942e-04
Validation auc = 0.692379
Epoch 434
Validation auc = 0.689646
Epoch 435
Validation auc = 0.685655
Epoch 436
Validation auc = 0.680844
Epoch 437
Validation auc = 0.697354
Epoch 438
Loss = 2.5319e-02, PNorm = 89.3807, GNorm = 0.2509, lr_0 = 9.7917e-04
Loss = 4.8896e-02, PNorm = 89.3917, GNorm = 0.8025, lr_0 = 9.7916e-04
Validation auc = 0.713755
Epoch 439
Validation auc = 0.724306
Epoch 440
Validation auc = 0.728351
Epoch 441
Validation auc = 0.731795
Epoch 442
Validation auc = 0.734419
Epoch 443
Loss = 7.2856e-02, PNorm = 89.5725, GNorm = 1.1318, lr_0 = 9.7893e-04
Validation auc = 0.740980
Epoch 444
Validation auc = 0.743932
Epoch 445
Validation auc = 0.750109
Epoch 446
Validation auc = 0.758911
Epoch 447
Validation auc = 0.765307
Epoch 448
Loss = 3.2855e-02, PNorm = 89.7737, GNorm = 0.5524, lr_0 = 9.7867e-04
Validation auc = 0.762410
Epoch 449
Validation auc = 0.758583
Epoch 450
Validation auc = 0.757599
Epoch 451
Validation auc = 0.754264
Epoch 452
Loss = 1.7661e-03, PNorm = 89.9064, GNorm = 0.0799, lr_0 = 9.7845e-04
Loss = 5.5605e-04, PNorm = 89.9156, GNorm = 0.0163, lr_0 = 9.7843e-04
Validation auc = 0.748907
Epoch 453
Validation auc = 0.742620
Epoch 454
Validation auc = 0.728515
Epoch 455
Validation auc = 0.713071
Epoch 456
Validation auc = 0.741226
Epoch 457
Loss = 1.1024e-02, PNorm = 90.0854, GNorm = 0.2415, lr_0 = 9.7819e-04
Loss = 2.4247e-03, PNorm = 90.1091, GNorm = 0.0582, lr_0 = 9.7817e-04
Validation auc = 0.755358
Epoch 458
Validation auc = 0.753827
Epoch 459
Validation auc = 0.732123
Epoch 460
Validation auc = 0.753389
Epoch 461
Validation auc = 0.740488
Epoch 462
Loss = 1.8013e-01, PNorm = 90.3729, GNorm = 1.5295, lr_0 = 9.7794e-04
Validation auc = 0.720534
Epoch 463
Validation auc = 0.712497
Epoch 464
Validation auc = 0.702930
Epoch 465
Validation auc = 0.699267
Epoch 466
Loss = 4.5307e-02, PNorm = 90.6556, GNorm = 2.3638, lr_0 = 9.7770e-04
Validation auc = 0.700634
Epoch 467
Validation auc = 0.701345
Epoch 468
Validation auc = 0.700415
Epoch 469
Validation auc = 0.700634
Epoch 470
Validation auc = 0.698939
Epoch 471
Loss = 9.8823e-02, PNorm = 90.8789, GNorm = 0.2045, lr_0 = 9.7746e-04
Loss = 5.0666e-02, PNorm = 90.8919, GNorm = 1.9493, lr_0 = 9.7744e-04
Validation auc = 0.694675
Epoch 472
Validation auc = 0.696370
Epoch 473
Validation auc = 0.696425
Epoch 474
Validation auc = 0.694129
Epoch 475
Validation auc = 0.695222
Epoch 476
Loss = 1.9915e-02, PNorm = 91.0387, GNorm = 0.3420, lr_0 = 9.7721e-04
Validation auc = 0.694730
Epoch 477
Validation auc = 0.696315
Epoch 478
Validation auc = 0.697791
Epoch 479
Validation auc = 0.696534
Epoch 480
Validation auc = 0.694238
Epoch 481
Loss = 1.3873e-02, PNorm = 91.1340, GNorm = 0.3076, lr_0 = 9.7695e-04
Validation auc = 0.694019
Epoch 482
Validation auc = 0.701290
Epoch 483
Validation auc = 0.706812
Epoch 484
Validation auc = 0.706046
Epoch 485
Loss = 1.4780e-01, PNorm = 91.2285, GNorm = 2.0534, lr_0 = 9.7673e-04
Loss = 1.9088e-03, PNorm = 91.2373, GNorm = 0.0425, lr_0 = 9.7671e-04
Validation auc = 0.719932
Epoch 486
Validation auc = 0.722119
Epoch 487
Validation auc = 0.722010
Epoch 488
Validation auc = 0.707768
Epoch 489
Validation auc = 0.718347
Epoch 490
Loss = 7.2407e-02, PNorm = 91.4000, GNorm = 0.3566, lr_0 = 9.7647e-04
Loss = 4.1028e-03, PNorm = 91.4113, GNorm = 0.0556, lr_0 = 9.7645e-04
Validation auc = 0.723814
Epoch 491
Validation auc = 0.725180
Epoch 492
Validation auc = 0.725016
Epoch 493
Validation auc = 0.724142
Epoch 494
Validation auc = 0.721627
Epoch 495
Loss = 4.7026e-02, PNorm = 91.5467, GNorm = 1.7290, lr_0 = 9.7623e-04
Validation auc = 0.722447
Epoch 496
Validation auc = 0.720096
Epoch 497
Validation auc = 0.717745
Epoch 498
Validation auc = 0.717581
Epoch 499
Loss = 1.0581e-02, PNorm = 91.6377, GNorm = 0.0809, lr_0 = 9.7599e-04
Validation auc = 0.716543
Epoch 500
Validation auc = 0.716324
Epoch 501
Validation auc = 0.715941
Epoch 502
Validation auc = 0.714903
Epoch 503
Validation auc = 0.714684
Epoch 504
Loss = 8.2685e-02, PNorm = 91.6939, GNorm = 0.5546, lr_0 = 9.7574e-04
Loss = 1.3685e-02, PNorm = 91.6967, GNorm = 0.3305, lr_0 = 9.7573e-04
Validation auc = 0.714137
Epoch 505
Validation auc = 0.711513
Epoch 506
Validation auc = 0.710639
Epoch 507
Validation auc = 0.711349
Epoch 508
Validation auc = 0.711787
Epoch 509
Loss = 1.2928e-02, PNorm = 91.7425, GNorm = 0.9004, lr_0 = 9.7550e-04
Validation auc = 0.713208
Epoch 510
Validation auc = 0.712552
Epoch 511
Validation auc = 0.713263
Epoch 512
Validation auc = 0.714028
Epoch 513
Validation auc = 0.715504
Epoch 514
Loss = 5.6516e-03, PNorm = 91.7880, GNorm = 0.1966, lr_0 = 9.7524e-04
Validation auc = 0.717308
Epoch 515
Validation auc = 0.719440
Epoch 516
Validation auc = 0.721299
Epoch 517
Validation auc = 0.724196
Epoch 518
Loss = 3.1461e-03, PNorm = 91.8186, GNorm = 0.0495, lr_0 = 9.7502e-04
Loss = 1.4053e-03, PNorm = 91.8211, GNorm = 0.0597, lr_0 = 9.7500e-04
Validation auc = 0.725891
Epoch 519
Validation auc = 0.727312
Epoch 520
Validation auc = 0.727312
Epoch 521
Validation auc = 0.724032
Epoch 522
Validation auc = 0.723923
Epoch 523
Loss = 2.5787e-03, PNorm = 91.8605, GNorm = 0.1435, lr_0 = 9.7476e-04
Loss = 6.2434e-05, PNorm = 91.8628, GNorm = 0.0079, lr_0 = 9.7474e-04
Validation auc = 0.723048
Epoch 524
Validation auc = 0.717253
Epoch 525
Validation auc = 0.707850
Epoch 526
Validation auc = 0.702329
Epoch 527
Validation auc = 0.700033
Epoch 528
Loss = 2.4090e-03, PNorm = 91.9098, GNorm = 0.1169, lr_0 = 9.7452e-04
Validation auc = 0.696370
Epoch 529
Validation auc = 0.694675
Epoch 530
Validation auc = 0.695550
Epoch 531
Validation auc = 0.701290
Epoch 532
Validation auc = 0.709873
Epoch 533
Loss = 1.4805e-03, PNorm = 91.9915, GNorm = 0.0320, lr_0 = 9.7426e-04
Validation auc = 0.716597
Epoch 534
Validation auc = 0.723048
Epoch 535
Validation auc = 0.729171
Epoch 536
Validation auc = 0.731139
Epoch 537
Loss = 2.9786e-02, PNorm = 92.0433, GNorm = 0.0862, lr_0 = 9.7403e-04
Loss = 4.9061e-04, PNorm = 92.0462, GNorm = 0.0121, lr_0 = 9.7401e-04
Validation auc = 0.729609
Epoch 538
Validation auc = 0.728133
Epoch 539
Validation auc = 0.729445
Epoch 540
Validation auc = 0.730155
Epoch 541
Validation auc = 0.730210
Epoch 542
Loss = 7.6312e-03, PNorm = 92.0810, GNorm = 0.1570, lr_0 = 9.7379e-04
Validation auc = 0.727531
Epoch 543
Validation auc = 0.720424
Epoch 544
Validation auc = 0.716051
Epoch 545
Validation auc = 0.715504
Epoch 546
Validation auc = 0.713755
Epoch 547
Loss = 1.2674e-02, PNorm = 92.1163, GNorm = 0.2212, lr_0 = 9.7353e-04
Validation auc = 0.713044
Epoch 548
Validation auc = 0.711459
Epoch 549
Validation auc = 0.711677
Epoch 550
Validation auc = 0.712005
Epoch 551
Loss = 8.1214e-03, PNorm = 92.1954, GNorm = 0.0653, lr_0 = 9.7331e-04
Loss = 9.7611e-03, PNorm = 92.2012, GNorm = 0.1759, lr_0 = 9.7329e-04
Validation auc = 0.711951
Epoch 552
Validation auc = 0.712005
Epoch 553
Validation auc = 0.710365
Epoch 554
Validation auc = 0.709873
Epoch 555
Validation auc = 0.708069
Epoch 556
Loss = 5.0854e-03, PNorm = 92.2665, GNorm = 0.0931, lr_0 = 9.7305e-04
Loss = 4.9357e-03, PNorm = 92.2705, GNorm = 0.1424, lr_0 = 9.7303e-04
Validation auc = 0.706812
Epoch 557
Validation auc = 0.705718
Epoch 558
Validation auc = 0.705500
Epoch 559
Validation auc = 0.704570
Epoch 560
Validation auc = 0.704352
Epoch 561
Loss = 9.5551e-02, PNorm = 92.3204, GNorm = 0.9694, lr_0 = 9.7281e-04
Validation auc = 0.704297
Epoch 562
Validation auc = 0.702712
Epoch 563
Validation auc = 0.702548
Epoch 564
Validation auc = 0.700853
Epoch 565
Validation auc = 0.698939
Epoch 566
Loss = 4.1322e-03, PNorm = 92.3568, GNorm = 0.0641, lr_0 = 9.7255e-04
Validation auc = 0.697682
Epoch 567
Validation auc = 0.697573
Epoch 568
Validation auc = 0.698611
Epoch 569
Validation auc = 0.699158
Epoch 570
Loss = 4.7060e-02, PNorm = 92.3770, GNorm = 0.8785, lr_0 = 9.7232e-04
Loss = 2.9196e-03, PNorm = 92.3779, GNorm = 0.0554, lr_0 = 9.7231e-04
Validation auc = 0.703313
Epoch 571
Validation auc = 0.706812
Epoch 572
Validation auc = 0.709873
Epoch 573
Validation auc = 0.711185
Epoch 574
Validation auc = 0.711185
Epoch 575
Loss = 1.2682e-01, PNorm = 92.4033, GNorm = 0.6232, lr_0 = 9.7208e-04
Validation auc = 0.710748
Epoch 576
Validation auc = 0.710584
Epoch 577
Validation auc = 0.710092
Epoch 578
Validation auc = 0.709162
Epoch 579
Validation auc = 0.708725
Epoch 580
Loss = 1.9520e-03, PNorm = 92.4271, GNorm = 0.0308, lr_0 = 9.7182e-04
Validation auc = 0.708780
Epoch 581
Validation auc = 0.709272
Epoch 582
Validation auc = 0.709272
Epoch 583
Validation auc = 0.709709
Epoch 584
Loss = 1.2113e-03, PNorm = 92.4623, GNorm = 0.0242, lr_0 = 9.7160e-04
Loss = 3.5010e-04, PNorm = 92.4653, GNorm = 0.0095, lr_0 = 9.7158e-04
Validation auc = 0.709764
Epoch 585
Validation auc = 0.706101
Epoch 586
Validation auc = 0.704625
Epoch 587
Validation auc = 0.704188
Epoch 588
Validation auc = 0.702548
Epoch 589
Loss = 4.4658e-03, PNorm = 92.4914, GNorm = 0.2230, lr_0 = 9.7134e-04
Loss = 4.1925e-04, PNorm = 92.4933, GNorm = 0.0129, lr_0 = 9.7132e-04
Validation auc = 0.701017
Epoch 590
Validation auc = 0.700634
Epoch 591
Validation auc = 0.701181
Epoch 592
Validation auc = 0.700962
Epoch 593
Validation auc = 0.701400
Epoch 594
Loss = 2.5444e-04, PNorm = 92.5299, GNorm = 0.0044, lr_0 = 9.7110e-04
Validation auc = 0.701618
Epoch 595
Validation auc = 0.703368
Epoch 596
Validation auc = 0.703258
Epoch 597
Validation auc = 0.703586
Epoch 598
Validation auc = 0.703860
Epoch 599
Loss = 1.2963e-02, PNorm = 92.5536, GNorm = 0.9038, lr_0 = 9.7084e-04
Validation auc = 0.704844
Epoch 600
Validation auc = 0.711076
Epoch 601
Validation auc = 0.721135
Epoch 602
Validation auc = 0.728843
Epoch 603
Loss = 8.5317e-03, PNorm = 92.6096, GNorm = 0.7964, lr_0 = 9.7062e-04
Loss = 4.5585e-04, PNorm = 92.6153, GNorm = 0.0210, lr_0 = 9.7060e-04
Validation auc = 0.731850
Epoch 604
Validation auc = 0.720752
Epoch 605
Validation auc = 0.703094
Epoch 606
Validation auc = 0.708452
Epoch 607
Validation auc = 0.720862
Epoch 608
Loss = 7.9358e-03, PNorm = 92.8169, GNorm = 0.0771, lr_0 = 9.7036e-04
Validation auc = 0.735403
Epoch 609
Validation auc = 0.739504
Epoch 610
Validation auc = 0.726274
Epoch 611
Validation auc = 0.690520
Epoch 612
Validation auc = 0.680461
Epoch 613
Loss = 5.9874e-02, PNorm = 93.0582, GNorm = 1.2327, lr_0 = 9.7012e-04
Validation auc = 0.672753
Epoch 614
Validation auc = 0.669746
Epoch 615
Validation auc = 0.670129
Epoch 616
Validation auc = 0.664881
Epoch 617
Loss = 9.1554e-03, PNorm = 93.2465, GNorm = 0.1757, lr_0 = 9.6990e-04
Loss = 6.2409e-03, PNorm = 93.2580, GNorm = 0.1164, lr_0 = 9.6988e-04
Validation auc = 0.656899
Epoch 618
Validation auc = 0.651214
Epoch 619
Validation auc = 0.644817
Epoch 620
Validation auc = 0.643833
Epoch 621
Validation auc = 0.648098
Epoch 622
Loss = 1.9724e-02, PNorm = 93.3636, GNorm = 0.2818, lr_0 = 9.6964e-04
Loss = 7.8456e-03, PNorm = 93.3697, GNorm = 0.2103, lr_0 = 9.6962e-04
Validation auc = 0.653947
Epoch 623
Validation auc = 0.658977
Epoch 624
Validation auc = 0.663241
Epoch 625
Validation auc = 0.665920
Epoch 626
Validation auc = 0.668598
Epoch 627
Loss = 4.8135e-03, PNorm = 93.4282, GNorm = 0.0599, lr_0 = 9.6940e-04
Validation auc = 0.670402
Epoch 628
Validation auc = 0.672862
Epoch 629
Validation auc = 0.674503
Epoch 630
Validation auc = 0.675705
Epoch 631
Validation auc = 0.677236
Epoch 632
Loss = 2.2382e-03, PNorm = 93.4590, GNorm = 0.0529, lr_0 = 9.6914e-04
Validation auc = 0.675159
Epoch 633
Validation auc = 0.679641
Epoch 634
Validation auc = 0.683359
Epoch 635
Validation auc = 0.689646
Epoch 636
Loss = 5.7452e-02, PNorm = 93.4710, GNorm = 0.1740, lr_0 = 9.6892e-04
Loss = 3.6783e-02, PNorm = 93.4744, GNorm = 1.4366, lr_0 = 9.6890e-04
Validation auc = 0.697518
Epoch 637
Validation auc = 0.708342
Epoch 638
Validation auc = 0.712224
Epoch 639
Validation auc = 0.712989
Epoch 640
Validation auc = 0.711623
Epoch 641
Loss = 2.4890e-02, PNorm = 93.5611, GNorm = 0.5119, lr_0 = 9.6866e-04
Validation auc = 0.708780
Epoch 642
Validation auc = 0.706046
Epoch 643
Validation auc = 0.702438
Epoch 644
Validation auc = 0.698338
Epoch 645
Validation auc = 0.695222
Epoch 646
Loss = 8.9930e-02, PNorm = 93.6478, GNorm = 0.5535, lr_0 = 9.6842e-04
Validation auc = 0.689974
Epoch 647
Validation auc = 0.688115
Epoch 648
Validation auc = 0.685163
Epoch 649
Validation auc = 0.680188
Epoch 650
Loss = 2.7003e-03, PNorm = 93.6887, GNorm = 0.0372, lr_0 = 9.6820e-04
Loss = 6.3453e-04, PNorm = 93.6926, GNorm = 0.0119, lr_0 = 9.6818e-04
Validation auc = 0.678657
Epoch 651
Validation auc = 0.678111
Epoch 652
Validation auc = 0.677673
Epoch 653
Validation auc = 0.678329
Epoch 654
Validation auc = 0.679477
Epoch 655
Loss = 4.5970e-03, PNorm = 93.7183, GNorm = 0.1904, lr_0 = 9.6794e-04
Loss = 2.9804e-03, PNorm = 93.7210, GNorm = 0.0644, lr_0 = 9.6792e-04
Validation auc = 0.680352
Epoch 656
Validation auc = 0.682265
Epoch 657
Validation auc = 0.683523
Epoch 658
Validation auc = 0.681445
Epoch 659
Validation auc = 0.677728
Epoch 660
Loss = 1.7968e-03, PNorm = 93.7522, GNorm = 0.0366, lr_0 = 9.6770e-04
Validation auc = 0.675596
Epoch 661
Validation auc = 0.674120
Epoch 662
Validation auc = 0.673956
Epoch 663
Validation auc = 0.677783
Epoch 664
Validation auc = 0.680407
Epoch 665
Loss = 1.0358e-02, PNorm = 93.8013, GNorm = 0.2813, lr_0 = 9.6744e-04
Validation auc = 0.680352
Epoch 666
Validation auc = 0.679587
Epoch 667
Validation auc = 0.679915
Epoch 668
Validation auc = 0.679969
Epoch 669
Loss = 2.7859e-03, PNorm = 93.8373, GNorm = 0.3961, lr_0 = 9.6722e-04
Loss = 3.1650e-04, PNorm = 93.8397, GNorm = 0.0090, lr_0 = 9.6720e-04
Validation auc = 0.682375
Epoch 670
Validation auc = 0.684616
Epoch 671
Validation auc = 0.687076
Epoch 672
Validation auc = 0.690028
Epoch 673
Validation auc = 0.691340
Epoch 674
Loss = 4.4612e-02, PNorm = 93.8664, GNorm = 0.6554, lr_0 = 9.6696e-04
Validation auc = 0.692106
Epoch 675
Validation auc = 0.697081
Epoch 676
Validation auc = 0.700689
Epoch 677
Validation auc = 0.704188
Epoch 678
Validation auc = 0.708288
Epoch 679
Loss = 2.7227e-04, PNorm = 93.8871, GNorm = 0.0049, lr_0 = 9.6672e-04
Validation auc = 0.711185
Epoch 680
Validation auc = 0.710529
Epoch 681
Validation auc = 0.707632
Epoch 682
Validation auc = 0.707468
Epoch 683
Loss = 7.6052e-03, PNorm = 93.9099, GNorm = 1.3258, lr_0 = 9.6648e-04
Validation auc = 0.705828
Epoch 684
Validation auc = 0.706374
Epoch 685
Validation auc = 0.695441
Epoch 686
Validation auc = 0.677728
Epoch 687
Validation auc = 0.676799
Epoch 688
Loss = 2.4169e-03, PNorm = 93.9482, GNorm = 0.0557, lr_0 = 9.6624e-04
Loss = 4.2832e-04, PNorm = 93.9527, GNorm = 0.0135, lr_0 = 9.6622e-04
Validation auc = 0.677509
Epoch 689
Validation auc = 0.678931
Epoch 690
Validation auc = 0.683632
Epoch 691
Validation auc = 0.685054
Epoch 692
Validation auc = 0.686967
Epoch 693
Loss = 2.5624e-02, PNorm = 94.0074, GNorm = 1.1498, lr_0 = 9.6600e-04
Validation auc = 0.685491
Epoch 694
Validation auc = 0.683523
Epoch 695
Validation auc = 0.682047
Epoch 696
Validation auc = 0.680844
Epoch 697
Validation auc = 0.679477
Epoch 698
Loss = 2.7668e-03, PNorm = 94.0535, GNorm = 0.1005, lr_0 = 9.6574e-04
Validation auc = 0.679313
Epoch 699
Validation auc = 0.678493
Epoch 700
Validation auc = 0.674885
Epoch 701
Validation auc = 0.674010
Epoch 702
Loss = 5.0381e-02, PNorm = 94.0875, GNorm = 1.0008, lr_0 = 9.6552e-04
Loss = 3.4706e-01, PNorm = 94.0888, GNorm = 11.7303, lr_0 = 9.6550e-04
Validation auc = 0.667942
Epoch 703
Validation auc = 0.650831
Epoch 704
Validation auc = 0.645036
Epoch 705
Validation auc = 0.639077
Epoch 706
Validation auc = 0.640171
Epoch 707
Loss = 5.2280e-02, PNorm = 94.1940, GNorm = 1.0782, lr_0 = 9.6526e-04
Loss = 1.5006e-03, PNorm = 94.2012, GNorm = 0.0486, lr_0 = 9.6525e-04
Validation auc = 0.643068
Epoch 708
Validation auc = 0.656024
Epoch 709
Validation auc = 0.659414
Epoch 710
Validation auc = 0.661655
Epoch 711
Validation auc = 0.663623
Epoch 712
Loss = 1.2069e-02, PNorm = 94.2998, GNorm = 0.3166, lr_0 = 9.6502e-04
Validation auc = 0.664170
Epoch 713
Validation auc = 0.663787
Epoch 714
Validation auc = 0.663241
Epoch 715
Validation auc = 0.661765
Epoch 716
Loss = 4.0840e-02, PNorm = 94.3967, GNorm = 0.0307, lr_0 = 9.6479e-04
Validation auc = 0.658047
Epoch 717
Validation auc = 0.655751
Epoch 718
Validation auc = 0.653838
Epoch 719
Validation auc = 0.654275
Epoch 720
Validation auc = 0.652908
Epoch 721
Loss = 2.6370e-03, PNorm = 94.4694, GNorm = 0.0317, lr_0 = 9.6455e-04
Loss = 7.9564e-04, PNorm = 94.4732, GNorm = 0.0209, lr_0 = 9.6453e-04
Validation auc = 0.652744
Epoch 722
Validation auc = 0.651870
Epoch 723
Validation auc = 0.651706
Epoch 724
Validation auc = 0.651924
Epoch 725
Validation auc = 0.650558
Epoch 726
Loss = 1.5311e-03, PNorm = 94.5075, GNorm = 0.0687, lr_0 = 9.6431e-04
Validation auc = 0.650284
Epoch 727
Validation auc = 0.651378
Epoch 728
Validation auc = 0.652307
Epoch 729
Validation auc = 0.653838
Epoch 730
Validation auc = 0.655040
Epoch 731
Loss = 2.1979e-03, PNorm = 94.5420, GNorm = 0.1686, lr_0 = 9.6405e-04
Validation auc = 0.655806
Epoch 732
Validation auc = 0.656517
Epoch 733
Validation auc = 0.658375
Epoch 734
Validation auc = 0.658266
Epoch 735
Loss = 8.5916e-02, PNorm = 94.5769, GNorm = 1.7698, lr_0 = 9.6383e-04
Loss = 4.0231e-05, PNorm = 94.5798, GNorm = 0.0015, lr_0 = 9.6381e-04
Validation auc = 0.660125
Epoch 736
Validation auc = 0.667068
Epoch 737
Validation auc = 0.668762
Epoch 738
Validation auc = 0.666685
Epoch 739
Validation auc = 0.664443
Epoch 740
Loss = 4.8069e-02, PNorm = 94.6400, GNorm = 1.3370, lr_0 = 9.6357e-04
Loss = 1.2370e+00, PNorm = 94.6391, GNorm = 13.3049, lr_0 = 9.6355e-04
Validation auc = 0.667122
Epoch 741
Validation auc = 0.684179
Epoch 742
Validation auc = 0.694129
Epoch 743
Validation auc = 0.701564
Epoch 744
Validation auc = 0.697354
Epoch 745
Loss = 1.5830e-01, PNorm = 94.8197, GNorm = 2.2654, lr_0 = 9.6333e-04
Validation auc = 0.698611
Epoch 746
Validation auc = 0.693965
Epoch 747
Validation auc = 0.681773
Epoch 748
Validation auc = 0.682047
Epoch 749
Loss = 3.4853e-02, PNorm = 95.0051, GNorm = 0.1282, lr_0 = 9.6309e-04
Validation auc = 0.688607
Epoch 750
Validation auc = 0.696151
Epoch 751
Validation auc = 0.701126
Epoch 752
Validation auc = 0.701345
Epoch 753
Validation auc = 0.698010
Epoch 754
Loss = 1.8719e-02, PNorm = 95.1583, GNorm = 0.1162, lr_0 = 9.6285e-04
Loss = 7.5210e-03, PNorm = 95.1703, GNorm = 0.2030, lr_0 = 9.6284e-04
Validation auc = 0.694839
Epoch 755
Validation auc = 0.696589
Epoch 756
Validation auc = 0.696971
Epoch 757
Validation auc = 0.694703
Epoch 758
Validation auc = 0.695550
Epoch 759
Loss = 7.7899e-03, PNorm = 95.3096, GNorm = 0.1360, lr_0 = 9.6262e-04
Validation auc = 0.696151
Epoch 760
Validation auc = 0.691067
Epoch 761
Validation auc = 0.682429
Epoch 762
Validation auc = 0.675295
Epoch 763
Validation auc = 0.689372
Epoch 764
Loss = 3.2485e-02, PNorm = 95.4769, GNorm = 1.0094, lr_0 = 9.6236e-04
Validation auc = 0.679095
Epoch 765
Validation auc = 0.668052
Epoch 766
Validation auc = 0.662093
Epoch 767
Validation auc = 0.661929
Epoch 768
Loss = 1.5467e-02, PNorm = 95.7125, GNorm = 0.1210, lr_0 = 9.6214e-04
Loss = 2.3399e-03, PNorm = 95.7257, GNorm = 0.0591, lr_0 = 9.6212e-04
Validation auc = 0.660562
Epoch 769
Validation auc = 0.662530
Epoch 770
Validation auc = 0.665701
Epoch 771
Validation auc = 0.667614
Epoch 772
Validation auc = 0.669309
Epoch 773
Loss = 1.1713e-01, PNorm = 95.8796, GNorm = 0.1451, lr_0 = 9.6188e-04
Loss = 6.7183e-03, PNorm = 95.8878, GNorm = 0.1278, lr_0 = 9.6186e-04
Validation auc = 0.675268
Epoch 774
Validation auc = 0.680735
Epoch 775
Validation auc = 0.690247
Epoch 776
Validation auc = 0.695003
Epoch 777
Validation auc = 0.697791
Epoch 778
Loss = 1.1101e-03, PNorm = 96.0183, GNorm = 0.0210, lr_0 = 9.6164e-04
Validation auc = 0.698338
Epoch 779
Validation auc = 0.702876
Epoch 780
Validation auc = 0.713263
Epoch 781
Validation auc = 0.716597
Epoch 782
Validation auc = 0.715504
Epoch 783
Loss = 6.2692e-02, PNorm = 96.2299, GNorm = 1.3131, lr_0 = 9.6139e-04
Validation auc = 0.712771
Epoch 784
Validation auc = 0.710256
Epoch 785
Validation auc = 0.707741
Epoch 786
Validation auc = 0.700853
Epoch 787
Loss = 9.9659e-02, PNorm = 96.3807, GNorm = 2.6251, lr_0 = 9.6117e-04
Loss = 2.3195e-01, PNorm = 96.3912, GNorm = 7.0177, lr_0 = 9.6115e-04
Validation auc = 0.692270
Epoch 788
Validation auc = 0.703368
Epoch 789
Validation auc = 0.699705
Epoch 790
Validation auc = 0.668434
Epoch 791
Validation auc = 0.655860
Epoch 792
Loss = 8.2818e-02, PNorm = 96.5732, GNorm = 0.8171, lr_0 = 9.6093e-04
Validation auc = 0.650886
Epoch 793
Validation auc = 0.654876
Epoch 794
Validation auc = 0.655259
Epoch 795
Validation auc = 0.654712
Epoch 796
Validation auc = 0.648754
Epoch 797
Loss = 2.0820e-01, PNorm = 96.7929, GNorm = 1.0286, lr_0 = 9.6067e-04
Validation auc = 0.641319
Epoch 798
Validation auc = 0.649191
Epoch 799
Validation auc = 0.655642
Epoch 800
Validation auc = 0.655587
Epoch 801
Loss = 1.0596e-01, PNorm = 96.9817, GNorm = 0.7698, lr_0 = 9.6045e-04
Loss = 3.5013e-02, PNorm = 96.9941, GNorm = 0.6542, lr_0 = 9.6043e-04
Validation auc = 0.651378
Epoch 802
Validation auc = 0.646621
Epoch 803
Validation auc = 0.643451
Epoch 804
Validation auc = 0.642904
Epoch 805
Validation auc = 0.644052
Epoch 806
Loss = 1.1185e-02, PNorm = 97.1490, GNorm = 0.1756, lr_0 = 9.6019e-04
Loss = 6.8374e-03, PNorm = 97.1582, GNorm = 0.1195, lr_0 = 9.6018e-04
Validation auc = 0.646239
Epoch 807
Validation auc = 0.648207
Epoch 808
Validation auc = 0.650230
Epoch 809
Validation auc = 0.652088
Epoch 810
Validation auc = 0.652471
Epoch 811
Loss = 7.9445e-03, PNorm = 97.2469, GNorm = 0.5450, lr_0 = 9.5996e-04
Validation auc = 0.648808
Epoch 812
Validation auc = 0.642931
Epoch 813
Validation auc = 0.650612
Epoch 814
Validation auc = 0.711787
Epoch 815
Validation auc = 0.755631
Epoch 816
Loss = 5.4560e-02, PNorm = 97.3335, GNorm = 1.0271, lr_0 = 9.5970e-04
Validation auc = 0.774929
Epoch 817
Validation auc = 0.778045
Epoch 818
Validation auc = 0.775476
Epoch 819
Validation auc = 0.770118
Epoch 820
Loss = 1.3316e-01, PNorm = 97.5033, GNorm = 1.9074, lr_0 = 9.5948e-04
Loss = 1.6410e-02, PNorm = 97.5151, GNorm = 0.2838, lr_0 = 9.5946e-04
Validation auc = 0.762902
Epoch 821
Validation auc = 0.755850
Epoch 822
Validation auc = 0.754975
Epoch 823
Validation auc = 0.752023
Epoch 824
Validation auc = 0.744861
Epoch 825
Loss = 6.3452e-03, PNorm = 97.6642, GNorm = 0.1481, lr_0 = 9.5924e-04
Validation auc = 0.734802
Epoch 826
Validation auc = 0.729554
Epoch 827
Validation auc = 0.734693
Epoch 828
Validation auc = 0.719686
Epoch 829
Validation auc = 0.716269
Epoch 830
Loss = 5.1438e-02, PNorm = 97.8281, GNorm = 1.1317, lr_0 = 9.5899e-04
Validation auc = 0.706046
Epoch 831
Validation auc = 0.696370
Epoch 832
Validation auc = 0.693965
Epoch 833
Validation auc = 0.696425
Epoch 834
Loss = 5.3785e-02, PNorm = 97.9408, GNorm = 0.7070, lr_0 = 9.5877e-04
Loss = 2.8492e-02, PNorm = 97.9499, GNorm = 0.3579, lr_0 = 9.5875e-04
Validation auc = 0.692981
Epoch 835
Validation auc = 0.689810
Epoch 836
Validation auc = 0.690138
Epoch 837
Validation auc = 0.694949
Epoch 838
Validation auc = 0.699322
Epoch 839
Loss = 4.9159e-02, PNorm = 98.0725, GNorm = 0.4493, lr_0 = 9.5851e-04
Loss = 2.2620e-01, PNorm = 98.0857, GNorm = 9.1103, lr_0 = 9.5849e-04
Validation auc = 0.709381
Epoch 840
Validation auc = 0.716406
Epoch 841
Validation auc = 0.720206
Epoch 842
Validation auc = 0.716379
Epoch 843
Validation auc = 0.693172
Epoch 844
Loss = 1.2921e-01, PNorm = 98.3016, GNorm = 4.8047, lr_0 = 9.5827e-04
Validation auc = 0.720206
Epoch 845
Validation auc = 0.711295
Epoch 846
Validation auc = 0.702548
Epoch 847
Validation auc = 0.697600
Epoch 848
Validation auc = 0.695167
Epoch 849
Loss = 4.0529e-03, PNorm = 98.6501, GNorm = 0.0779, lr_0 = 9.5802e-04
Validation auc = 0.693227
Epoch 850
Validation auc = 0.695331
Epoch 851
Validation auc = 0.695769
Epoch 852
Validation auc = 0.693801
Epoch 853
Loss = 3.0228e-03, PNorm = 98.8492, GNorm = 0.1208, lr_0 = 9.5780e-04
Loss = 8.1619e-05, PNorm = 98.8592, GNorm = 0.0076, lr_0 = 9.5778e-04
Validation auc = 0.695495
Epoch 854
Validation auc = 0.697573
Epoch 855
Validation auc = 0.700415
Epoch 856
Validation auc = 0.702028
Epoch 857
Validation auc = 0.703942
Epoch 858
Loss = 3.0187e-02, PNorm = 98.9408, GNorm = 0.0410, lr_0 = 9.5754e-04
Validation auc = 0.706812
Epoch 859
Validation auc = 0.710065
Epoch 860
Validation auc = 0.712251
Epoch 861
Validation auc = 0.713399
Epoch 862
Validation auc = 0.714903
Epoch 863
Loss = 5.0438e-03, PNorm = 99.0208, GNorm = 0.2780, lr_0 = 9.5730e-04
Validation auc = 0.715094
Epoch 864
Validation auc = 0.701728
Epoch 865
Validation auc = 0.684288
Epoch 866
Validation auc = 0.664935
Epoch 867
Loss = 3.6135e-01, PNorm = 99.1299, GNorm = 3.1847, lr_0 = 9.5708e-04
Loss = 4.0944e-03, PNorm = 99.1420, GNorm = 0.0694, lr_0 = 9.5707e-04
Validation auc = 0.686967
Epoch 868
Validation auc = 0.703641
Epoch 869
Validation auc = 0.706866
Epoch 870
Validation auc = 0.713372
Epoch 871
Validation auc = 0.720260
Epoch 872
Loss = 2.7945e-02, PNorm = 99.3577, GNorm = 0.0873, lr_0 = 9.5683e-04
Loss = 6.3567e-02, PNorm = 99.3726, GNorm = 2.7549, lr_0 = 9.5681e-04
Validation auc = 0.729882
Epoch 873
Validation auc = 0.760442
Epoch 874
Validation auc = 0.770610
Epoch 875
Validation auc = 0.772688
Epoch 876
Validation auc = 0.767221
Epoch 877
Loss = 1.8362e-02, PNorm = 99.5522, GNorm = 0.3769, lr_0 = 9.5659e-04
Validation auc = 0.764706
Epoch 878
Validation auc = 0.756724
Epoch 879
Validation auc = 0.752679
Epoch 880
Validation auc = 0.744260
Epoch 881
Validation auc = 0.732424
Epoch 882
Loss = 2.3754e-01, PNorm = 99.6840, GNorm = 3.7476, lr_0 = 9.5634e-04
Validation auc = 0.735294
Epoch 883
Validation auc = 0.726219
Epoch 884
Validation auc = 0.713591
Epoch 885
Validation auc = 0.710147
Epoch 886
Loss = 6.2604e-02, PNorm = 99.7748, GNorm = 1.4163, lr_0 = 9.5612e-04
Loss = 3.7122e-03, PNorm = 99.7864, GNorm = 0.0622, lr_0 = 9.5610e-04
Validation auc = 0.705445
Epoch 887
Validation auc = 0.700251
Epoch 888
Validation auc = 0.693637
Epoch 889
Validation auc = 0.689591
Epoch 890
Validation auc = 0.689372
Epoch 891
Loss = 1.5236e-02, PNorm = 99.9831, GNorm = 0.1344, lr_0 = 9.5586e-04
Validation auc = 0.685436
Epoch 892
Validation auc = 0.681773
Epoch 893
Validation auc = 0.680079
Epoch 894
Validation auc = 0.680680
Epoch 895
Validation auc = 0.684015
Epoch 896
Loss = 4.6876e-02, PNorm = 100.1740, GNorm = 0.7356, lr_0 = 9.5563e-04
Validation auc = 0.691504
Epoch 897
Validation auc = 0.694347
Epoch 898
Validation auc = 0.715285
Epoch 899
Validation auc = 0.727039
Epoch 900
Loss = 7.1283e-02, PNorm = 100.3086, GNorm = 0.9432, lr_0 = 9.5541e-04
Loss = 2.6837e-02, PNorm = 100.3273, GNorm = 0.4251, lr_0 = 9.5539e-04
Validation auc = 0.733982
Epoch 901
Validation auc = 0.735622
Epoch 902
Validation auc = 0.734474
Epoch 903
Validation auc = 0.730866
Epoch 904
Validation auc = 0.727586
Epoch 905
Loss = 2.0981e-02, PNorm = 100.5822, GNorm = 0.4374, lr_0 = 9.5515e-04
Loss = 5.0192e-03, PNorm = 100.5970, GNorm = 0.0901, lr_0 = 9.5513e-04
Validation auc = 0.722338
Epoch 906
Validation auc = 0.719440
Epoch 907
Validation auc = 0.720698
Epoch 908
Validation auc = 0.731139
Epoch 909
Validation auc = 0.739941
Epoch 910
Loss = 5.0613e-03, PNorm = 100.7371, GNorm = 0.0682, lr_0 = 9.5491e-04
Validation auc = 0.740160
Epoch 911
Validation auc = 0.739230
Epoch 912
Validation auc = 0.740050
Epoch 913
Validation auc = 0.739449
Epoch 914
Validation auc = 0.738301
Epoch 915
Loss = 7.1895e-03, PNorm = 100.8382, GNorm = 0.1071, lr_0 = 9.5466e-04
Validation auc = 0.736223
Epoch 916
Validation auc = 0.736661
Epoch 917
Validation auc = 0.738356
Epoch 918
Validation auc = 0.741800
Epoch 919
Loss = 4.7028e-02, PNorm = 100.9268, GNorm = 2.2239, lr_0 = 9.5444e-04
Loss = 8.9264e-01, PNorm = 100.9304, GNorm = 9.2447, lr_0 = 9.5442e-04
Validation auc = 0.728242
Epoch 920
Validation auc = 0.736934
Epoch 921
Validation auc = 0.739558
Epoch 922
Validation auc = 0.739230
Epoch 923
Validation auc = 0.736606
Epoch 924
Loss = 1.7749e-02, PNorm = 101.1294, GNorm = 0.2026, lr_0 = 9.5419e-04
Validation auc = 0.733599
Epoch 925
Validation auc = 0.732506
Epoch 926
Validation auc = 0.729390
Epoch 927
Validation auc = 0.727094
Epoch 928
Validation auc = 0.726711
Epoch 929
Loss = 1.7051e-02, PNorm = 101.2852, GNorm = 0.2228, lr_0 = 9.5395e-04
Validation auc = 0.726164
Epoch 930
Validation auc = 0.724743
Epoch 931
Validation auc = 0.723704
Epoch 932
Validation auc = 0.722392
Epoch 933
Loss = 4.3521e-03, PNorm = 101.3795, GNorm = 0.0180, lr_0 = 9.5371e-04
Validation auc = 0.721463
Epoch 934
Validation auc = 0.720042
Epoch 935
Validation auc = 0.715449
Epoch 936
Validation auc = 0.711240
Epoch 937
Validation auc = 0.709108
Epoch 938
Loss = 3.0745e-03, PNorm = 101.4307, GNorm = 0.1011, lr_0 = 9.5348e-04
Loss = 1.6910e-03, PNorm = 101.4331, GNorm = 0.0527, lr_0 = 9.5346e-04
Validation auc = 0.707686
Epoch 939
Validation auc = 0.708288
Epoch 940
Validation auc = 0.708561
Epoch 941
Validation auc = 0.710830
Epoch 942
Validation auc = 0.711978
Epoch 943
Loss = 8.6037e-04, PNorm = 101.4706, GNorm = 0.0214, lr_0 = 9.5324e-04
Validation auc = 0.712525
Epoch 944
Validation auc = 0.712935
Epoch 945
Validation auc = 0.713700
Epoch 946
Validation auc = 0.715395
Epoch 947
Validation auc = 0.720315
Epoch 948
Loss = 2.6004e-01, PNorm = 101.5024, GNorm = 1.2476, lr_0 = 9.5299e-04
Validation auc = 0.708124
Epoch 949
Validation auc = 0.706347
Epoch 950
Validation auc = 0.706347
Epoch 951
Validation auc = 0.714520
Epoch 952
Loss = 5.3297e-02, PNorm = 101.5241, GNorm = 0.2199, lr_0 = 9.5277e-04
Loss = 1.6041e-03, PNorm = 101.5282, GNorm = 0.0457, lr_0 = 9.5275e-04
Validation auc = 0.729335
Epoch 953
Validation auc = 0.752460
Epoch 954
Validation auc = 0.764597
Epoch 955
Validation auc = 0.768642
Epoch 956
Validation auc = 0.773562
Epoch 957
Loss = 1.5370e-03, PNorm = 101.5954, GNorm = 0.0132, lr_0 = 9.5251e-04
Loss = 2.6529e-04, PNorm = 101.5999, GNorm = 0.0131, lr_0 = 9.5250e-04
Validation auc = 0.776350
Epoch 958
Validation auc = 0.778865
Epoch 959
Validation auc = 0.779002
Epoch 960
Validation auc = 0.778756
Epoch 961
Validation auc = 0.777908
Epoch 962
Loss = 5.2610e-03, PNorm = 101.6459, GNorm = 0.3584, lr_0 = 9.5228e-04
Validation auc = 0.774218
Epoch 963
Validation auc = 0.728789
Epoch 964
Validation auc = 0.709272
Epoch 965
Validation auc = 0.701099
Epoch 966
Loss = 3.3836e-03, PNorm = 101.6809, GNorm = 0.0479, lr_0 = 9.5204e-04
Validation auc = 0.698994
Epoch 967
Validation auc = 0.693172
Epoch 968
Validation auc = 0.698092
Epoch 969
Validation auc = 0.708780
Epoch 970
Validation auc = 0.713809
Epoch 971
Loss = 2.9211e-02, PNorm = 101.7321, GNorm = 0.2639, lr_0 = 9.5180e-04
Loss = 5.8129e-02, PNorm = 101.7430, GNorm = 0.9170, lr_0 = 9.5179e-04
Validation auc = 0.717527
Epoch 972
Validation auc = 0.716707
Epoch 973
Validation auc = 0.714465
Epoch 974
Validation auc = 0.712443
Epoch 975
Validation auc = 0.709490
Epoch 976
Loss = 3.0908e-02, PNorm = 101.9382, GNorm = 0.7738, lr_0 = 9.5157e-04
Validation auc = 0.700142
Epoch 977
Validation auc = 0.692106
Epoch 978
Validation auc = 0.686038
Epoch 979
Validation auc = 0.679532
Epoch 980
Validation auc = 0.672534
Epoch 981
Loss = 1.6369e-01, PNorm = 102.1311, GNorm = 2.0320, lr_0 = 9.5132e-04
Validation auc = 0.672644
Epoch 982
Validation auc = 0.687732
Epoch 983
Validation auc = 0.705828
Epoch 984
Validation auc = 0.708998
Epoch 985
Loss = 1.4422e-02, PNorm = 102.3183, GNorm = 0.8535, lr_0 = 9.5110e-04
Loss = 5.4076e-03, PNorm = 102.3332, GNorm = 0.1186, lr_0 = 9.5108e-04
Validation auc = 0.710256
Epoch 986
Validation auc = 0.709162
Epoch 987
Validation auc = 0.713700
Epoch 988
Validation auc = 0.714684
Epoch 989
Validation auc = 0.713481
Epoch 990
Loss = 1.0661e-01, PNorm = 102.5150, GNorm = 1.6324, lr_0 = 9.5084e-04
Loss = 2.8433e-03, PNorm = 102.5255, GNorm = 0.0607, lr_0 = 9.5083e-04
Validation auc = 0.712333
Epoch 991
Validation auc = 0.706921
Epoch 992
Validation auc = 0.704516
Epoch 993
Validation auc = 0.703422
Epoch 994
Validation auc = 0.702985
Epoch 995
Loss = 6.2378e-03, PNorm = 102.6373, GNorm = 0.1616, lr_0 = 9.5061e-04
Validation auc = 0.704734
Epoch 996
Validation auc = 0.707905
Epoch 997
Validation auc = 0.712825
Epoch 998
Validation auc = 0.714793
Epoch 999
Loss = 3.2033e-03, PNorm = 102.7127, GNorm = 0.0125, lr_0 = 9.5037e-04
Validation auc = 0.716269
Epoch 1000
Validation auc = 0.716816
Epoch 1001
Validation auc = 0.715285
Epoch 1002
Validation auc = 0.715231
Epoch 1003
Validation auc = 0.715668
Epoch 1004
Loss = 1.2447e-02, PNorm = 102.7585, GNorm = 0.8234, lr_0 = 9.5014e-04
Loss = 1.1708e-03, PNorm = 102.7621, GNorm = 0.0245, lr_0 = 9.5012e-04
Validation auc = 0.716105
Epoch 1005
Validation auc = 0.716215
Epoch 1006
Validation auc = 0.718183
Epoch 1007
Validation auc = 0.720479
Epoch 1008
Validation auc = 0.718456
Epoch 1009
Loss = 1.3067e-03, PNorm = 102.7963, GNorm = 0.0210, lr_0 = 9.4990e-04
Validation auc = 0.715012
Epoch 1010
Validation auc = 0.712880
Epoch 1011
Validation auc = 0.711131
Epoch 1012
Validation auc = 0.709217
Epoch 1013
Validation auc = 0.709654
Epoch 1014
Loss = 4.5954e-03, PNorm = 102.8247, GNorm = 0.1030, lr_0 = 9.4965e-04
Validation auc = 0.710037
Epoch 1015
Validation auc = 0.710639
Epoch 1016
Validation auc = 0.711404
Epoch 1017
Validation auc = 0.712716
Epoch 1018
Loss = 1.3026e-03, PNorm = 102.8498, GNorm = 0.0125, lr_0 = 9.4943e-04
Loss = 2.0003e-04, PNorm = 102.8518, GNorm = 0.0087, lr_0 = 9.4941e-04
Validation auc = 0.713645
Epoch 1019
Validation auc = 0.714903
Epoch 1020
Validation auc = 0.713973
Epoch 1021
Validation auc = 0.714957
Epoch 1022
Validation auc = 0.712224
Epoch 1023
Loss = 1.7536e-03, PNorm = 102.8826, GNorm = 0.0226, lr_0 = 9.4918e-04
Loss = 7.1004e-04, PNorm = 102.8852, GNorm = 0.0222, lr_0 = 9.4916e-04
Validation auc = 0.711677
Epoch 1024
Validation auc = 0.711322
Epoch 1025
Validation auc = 0.712033
Epoch 1026
Validation auc = 0.712907
Epoch 1027
Validation auc = 0.714110
Epoch 1028
Loss = 1.0695e-03, PNorm = 102.9075, GNorm = 0.0360, lr_0 = 9.4894e-04
Validation auc = 0.715531
Epoch 1029
Validation auc = 0.716898
Epoch 1030
Validation auc = 0.718347
Epoch 1031
Validation auc = 0.716406
Epoch 1032
Validation auc = 0.715449
Epoch 1033
Loss = 1.1741e-02, PNorm = 102.9206, GNorm = 0.3748, lr_0 = 9.4869e-04
Validation auc = 0.713919
Epoch 1034
Validation auc = 0.713071
Epoch 1035
Validation auc = 0.712607
Epoch 1036
Validation auc = 0.712224
Epoch 1037
Loss = 1.3183e-03, PNorm = 102.9500, GNorm = 0.0529, lr_0 = 9.4847e-04
Loss = 4.4070e-04, PNorm = 102.9519, GNorm = 0.0137, lr_0 = 9.4845e-04
Validation auc = 0.711705
Epoch 1038
Validation auc = 0.710611
Epoch 1039
Validation auc = 0.709818
Epoch 1040
Validation auc = 0.708725
Epoch 1041
Validation auc = 0.709135
Epoch 1042
Loss = 4.3255e-03, PNorm = 102.9765, GNorm = 0.1653, lr_0 = 9.4823e-04
Validation auc = 0.708534
Epoch 1043
Validation auc = 0.708479
Epoch 1044
Validation auc = 0.709190
Epoch 1045
Validation auc = 0.709545
Epoch 1046
Validation auc = 0.709381
Epoch 1047
Loss = 1.6616e-03, PNorm = 103.0088, GNorm = 0.1067, lr_0 = 9.4798e-04
Validation auc = 0.709053
Epoch 1048
Validation auc = 0.709108
Epoch 1049
Validation auc = 0.709381
Epoch 1050
Validation auc = 0.709490
Epoch 1051
Loss = 2.6193e-04, PNorm = 103.0262, GNorm = 0.0067, lr_0 = 9.4776e-04
Loss = 3.0536e-05, PNorm = 103.0270, GNorm = 0.0013, lr_0 = 9.4775e-04
Validation auc = 0.709436
Epoch 1052
Validation auc = 0.710857
Epoch 1053
Validation auc = 0.711787
Epoch 1054
Validation auc = 0.710447
Epoch 1055
Validation auc = 0.710065
Epoch 1056
Loss = 9.3144e-04, PNorm = 103.0536, GNorm = 0.1191, lr_0 = 9.4751e-04
Loss = 1.1817e+00, PNorm = 103.0480, GNorm = 7.8622, lr_0 = 9.4749e-04
Validation auc = 0.708588
Epoch 1057
Validation auc = 0.703914
Epoch 1058
Validation auc = 0.702794
Epoch 1059
Validation auc = 0.702548
Epoch 1060
Validation auc = 0.701618
Epoch 1061
Loss = 8.3908e-03, PNorm = 103.0653, GNorm = 0.0820, lr_0 = 9.4728e-04
Validation auc = 0.697955
Epoch 1062
Validation auc = 0.696151
Epoch 1063
Validation auc = 0.696315
Epoch 1064
Validation auc = 0.693309
Epoch 1065
Validation auc = 0.692051
Epoch 1066
Loss = 9.0350e-03, PNorm = 103.1676, GNorm = 0.0876, lr_0 = 9.4702e-04
Validation auc = 0.691012
Epoch 1067
Validation auc = 0.693418
Epoch 1068
Validation auc = 0.694511
Epoch 1069
Validation auc = 0.693801
Epoch 1070
Loss = 7.0495e-03, PNorm = 103.2598, GNorm = 0.0968, lr_0 = 9.4681e-04
Loss = 6.5164e-03, PNorm = 103.2665, GNorm = 0.1115, lr_0 = 9.4679e-04
Validation auc = 0.694402
Epoch 1071
Validation auc = 0.695386
Epoch 1072
Validation auc = 0.694457
Epoch 1073
Validation auc = 0.688388
Epoch 1074
Validation auc = 0.684671
Epoch 1075
Loss = 1.4831e-02, PNorm = 103.3440, GNorm = 0.4688, lr_0 = 9.4657e-04
Validation auc = 0.686530
Epoch 1076
Validation auc = 0.689864
Epoch 1077
Validation auc = 0.693309
Epoch 1078
Validation auc = 0.692981
Epoch 1079
Validation auc = 0.693910
Epoch 1080
Loss = 2.3682e-03, PNorm = 103.4004, GNorm = 0.0647, lr_0 = 9.4632e-04
Validation auc = 0.695113
Epoch 1081
Validation auc = 0.695659
Epoch 1082
Validation auc = 0.694949
Epoch 1083
Validation auc = 0.694785
Epoch 1084
Loss = 2.9892e-03, PNorm = 103.4441, GNorm = 0.1374, lr_0 = 9.4610e-04
Loss = 2.2907e-05, PNorm = 103.4466, GNorm = 0.0009, lr_0 = 9.4608e-04
Validation auc = 0.695003
Epoch 1085
Validation auc = 0.699049
Epoch 1086
Validation auc = 0.703696
Epoch 1087
Validation auc = 0.706320
Epoch 1088
Validation auc = 0.696370
Epoch 1089
Loss = 1.3703e-01, PNorm = 103.7461, GNorm = 0.8348, lr_0 = 9.4585e-04
Loss = 3.0743e-03, PNorm = 103.7792, GNorm = 0.1022, lr_0 = 9.4583e-04
Validation auc = 0.696534
Epoch 1090
Validation auc = 0.699541
Epoch 1091
Validation auc = 0.712552
Epoch 1092
Validation auc = 0.721080
Epoch 1093
Validation auc = 0.727148
Epoch 1094
Loss = 3.7437e-02, PNorm = 104.2461, GNorm = 0.4362, lr_0 = 9.4561e-04
Validation auc = 0.727312
Epoch 1095
Validation auc = 0.718784
Epoch 1096
Validation auc = 0.710147
Epoch 1097
Validation auc = 0.704188
Epoch 1098
Validation auc = 0.695878
Epoch 1099
Loss = 4.3171e-02, PNorm = 104.6138, GNorm = 0.9239, lr_0 = 9.4536e-04
Validation auc = 0.697299
Epoch 1100
Validation auc = 0.698393
Epoch 1101
Validation auc = 0.696042
Epoch 1102
Validation auc = 0.693527
Epoch 1103
Loss = 3.8772e-03, PNorm = 104.8088, GNorm = 0.1097, lr_0 = 9.4515e-04
Loss = 6.0126e-03, PNorm = 104.8195, GNorm = 0.1255, lr_0 = 9.4513e-04
Validation auc = 0.691176
Epoch 1104
Validation auc = 0.685382
Epoch 1105
Validation auc = 0.684398
Epoch 1106
Validation auc = 0.707522
Epoch 1107
Validation auc = 0.725235
Epoch 1108
Loss = 9.5528e-02, PNorm = 105.0014, GNorm = 0.2433, lr_0 = 9.4489e-04
Validation auc = 0.737809
Epoch 1109
Validation auc = 0.745572
Epoch 1110
Validation auc = 0.759950
Epoch 1111
Validation auc = 0.767658
Epoch 1112
Validation auc = 0.770829
Epoch 1113
Loss = 2.9208e-02, PNorm = 105.1973, GNorm = 0.3563, lr_0 = 9.4466e-04
Validation auc = 0.765963
Epoch 1114
Validation auc = 0.750984
Epoch 1115
Validation auc = 0.737044
Epoch 1116
Validation auc = 0.733709
Epoch 1117
Loss = 6.4553e-02, PNorm = 105.3466, GNorm = 0.2456, lr_0 = 9.4444e-04
Loss = 1.3898e-02, PNorm = 105.3586, GNorm = 0.2940, lr_0 = 9.4443e-04
Validation auc = 0.734857
Epoch 1118
Validation auc = 0.736825
Epoch 1119
Validation auc = 0.737262
Epoch 1120
Validation auc = 0.738246
Epoch 1121
Validation auc = 0.738574
Epoch 1122
Loss = 6.1642e-03, PNorm = 105.4819, GNorm = 0.0612, lr_0 = 9.4419e-04
Loss = 7.2229e-04, PNorm = 105.4879, GNorm = 0.0184, lr_0 = 9.4417e-04
Validation auc = 0.739449
Epoch 1123
Validation auc = 0.737098
Epoch 1124
Validation auc = 0.732069
Epoch 1125
Validation auc = 0.729882
Epoch 1126
Validation auc = 0.729335
Epoch 1127
Loss = 3.6861e-02, PNorm = 105.5388, GNorm = 0.7222, lr_0 = 9.4396e-04
Validation auc = 0.727914
Epoch 1128
Validation auc = 0.727367
Epoch 1129
Validation auc = 0.726930
Epoch 1130
Validation auc = 0.726000
Epoch 1131
Validation auc = 0.725016
Epoch 1132
Loss = 6.6741e-03, PNorm = 105.6434, GNorm = 0.1119, lr_0 = 9.4371e-04
Validation auc = 0.723595
Epoch 1133
Validation auc = 0.718894
Epoch 1134
Validation auc = 0.714465
Epoch 1135
Validation auc = 0.712224
Epoch 1136
Loss = 4.8212e-03, PNorm = 105.7075, GNorm = 0.0976, lr_0 = 9.4349e-04
Loss = 2.6059e-03, PNorm = 105.7120, GNorm = 0.0488, lr_0 = 9.4347e-04
Validation auc = 0.710311
Epoch 1137
Validation auc = 0.710420
Epoch 1138
Validation auc = 0.708889
Epoch 1139
Validation auc = 0.711841
Epoch 1140
Validation auc = 0.714465
Epoch 1141
Loss = 3.3206e-03, PNorm = 105.7886, GNorm = 0.0517, lr_0 = 9.4324e-04
Validation auc = 0.717089
Epoch 1142
Validation auc = 0.717308
Epoch 1143
Validation auc = 0.717800
Epoch 1144
Validation auc = 0.717253
Epoch 1145
Validation auc = 0.716925
Epoch 1146
Loss = 2.1058e-04, PNorm = 105.8639, GNorm = 0.0046, lr_0 = 9.4300e-04
Validation auc = 0.715668
Epoch 1147
Validation auc = 0.710119
Epoch 1148
Validation auc = 0.708260
Epoch 1149
Validation auc = 0.706320
Epoch 1150
Loss = 6.0025e-03, PNorm = 105.9037, GNorm = 0.0162, lr_0 = 9.4279e-04
Loss = 8.9405e-06, PNorm = 105.9072, GNorm = 0.0004, lr_0 = 9.4277e-04
Validation auc = 0.705855
Epoch 1151
Validation auc = 0.708506
Epoch 1152
Validation auc = 0.709162
Epoch 1153
Validation auc = 0.709600
Epoch 1154
Validation auc = 0.709654
Epoch 1155
Loss = 1.7703e-04, PNorm = 105.9488, GNorm = 0.0033, lr_0 = 9.4253e-04
Loss = 3.5365e-06, PNorm = 105.9507, GNorm = 0.0001, lr_0 = 9.4252e-04
Validation auc = 0.709928
Epoch 1156
Validation auc = 0.710147
Epoch 1157
Validation auc = 0.710147
Epoch 1158
Validation auc = 0.707304
Epoch 1159
Validation auc = 0.707194
Epoch 1160
Loss = 4.4008e-02, PNorm = 105.9672, GNorm = 1.7452, lr_0 = 9.4230e-04
Validation auc = 0.705254
Epoch 1161
Validation auc = 0.703723
Epoch 1162
Validation auc = 0.702657
Epoch 1163
Validation auc = 0.702165
Epoch 1164
Validation auc = 0.702302
Epoch 1165
Loss = 3.4322e-04, PNorm = 105.9920, GNorm = 0.0134, lr_0 = 9.4205e-04
Validation auc = 0.703286
Epoch 1166
Validation auc = 0.703149
Epoch 1167
Validation auc = 0.703914
Epoch 1168
Validation auc = 0.704461
Epoch 1169
Loss = 1.1233e-02, PNorm = 106.0201, GNorm = 0.0014, lr_0 = 9.4183e-04
Loss = 3.2282e-04, PNorm = 106.0216, GNorm = 0.0109, lr_0 = 9.4182e-04
Validation auc = 0.700306
Epoch 1170
Validation auc = 0.698010
Epoch 1171
Validation auc = 0.697245
Epoch 1172
Validation auc = 0.696261
Epoch 1173
Validation auc = 0.695304
Epoch 1174
Loss = 2.3091e-03, PNorm = 106.0439, GNorm = 0.0011, lr_0 = 9.4158e-04
Validation auc = 0.695577
Epoch 1175
Validation auc = 0.695413
Epoch 1176
Validation auc = 0.695796
Epoch 1177
Validation auc = 0.696124
Epoch 1178
Validation auc = 0.696179
Epoch 1179
Loss = 4.9768e-05, PNorm = 106.0595, GNorm = 0.0015, lr_0 = 9.4135e-04
Validation auc = 0.696288
Epoch 1180
Validation auc = 0.696097
Epoch 1181
Validation auc = 0.695905
Epoch 1182
Validation auc = 0.695277
Epoch 1183
Loss = 3.5378e-02, PNorm = 106.0589, GNorm = 0.0001, lr_0 = 9.4112e-04
Validation auc = 0.696370
Epoch 1184
Validation auc = 0.701618
Epoch 1185
Validation auc = 0.704461
Epoch 1186
Validation auc = 0.704898
Epoch 1187
Validation auc = 0.704953
Epoch 1188
Loss = 8.1988e-05, PNorm = 106.0751, GNorm = 0.0017, lr_0 = 9.4088e-04
Loss = 1.2071e-02, PNorm = 106.0763, GNorm = 0.6883, lr_0 = 9.4087e-04
Validation auc = 0.704789
Epoch 1189
Validation auc = 0.706156
Epoch 1190
Validation auc = 0.706374
Epoch 1191
Validation auc = 0.706921
Epoch 1192
Validation auc = 0.706757
Epoch 1193
Loss = 3.3310e-05, PNorm = 106.1020, GNorm = 0.0008, lr_0 = 9.4065e-04
Validation auc = 0.707194
Epoch 1194
Validation auc = 0.707358
Epoch 1195
Validation auc = 0.707522
Epoch 1196
Validation auc = 0.707905
Epoch 1197
Validation auc = 0.707085
Epoch 1198
Loss = 2.4734e-04, PNorm = 106.1249, GNorm = 0.0066, lr_0 = 9.4040e-04
Validation auc = 0.706702
Epoch 1199
Validation auc = 0.706265
Epoch 1200
Validation auc = 0.705773
Epoch 1201
Validation auc = 0.705882
Epoch 1202
Loss = 4.2013e-03, PNorm = 106.1391, GNorm = 0.5620, lr_0 = 9.4018e-04
Loss = 2.3842e-07, PNorm = 106.1400, GNorm = 0.0000, lr_0 = 9.4016e-04
Validation auc = 0.703340
Epoch 1203
Validation auc = 0.710420
Epoch 1204
Validation auc = 0.720096
Epoch 1205
Validation auc = 0.718948
Epoch 1206
Validation auc = 0.707112
Epoch 1207
Loss = 1.9968e-02, PNorm = 106.2206, GNorm = 0.9608, lr_0 = 9.3993e-04
Loss = 3.1213e-03, PNorm = 106.2363, GNorm = 0.0846, lr_0 = 9.3991e-04
Validation auc = 0.705691
Epoch 1208
Validation auc = 0.707522
Epoch 1209
Validation auc = 0.712825
Epoch 1210
Validation auc = 0.716597
Epoch 1211
Validation auc = 0.719386
Epoch 1212
Loss = 2.6055e-02, PNorm = 106.5217, GNorm = 0.8534, lr_0 = 9.3970e-04
Validation auc = 0.719932
Epoch 1213
Validation auc = 0.718729
Epoch 1214
Validation auc = 0.717253
Epoch 1215
Validation auc = 0.715176
Epoch 1216
Loss = 3.7164e-02, PNorm = 106.6955, GNorm = 0.1290, lr_0 = 9.3946e-04
Validation auc = 0.711021
Epoch 1217
Validation auc = 0.701919
Epoch 1218
Validation auc = 0.698147
Epoch 1219
Validation auc = 0.693500
Epoch 1220
Validation auc = 0.698010
Epoch 1221
Loss = 2.5941e-03, PNorm = 106.8113, GNorm = 0.0831, lr_0 = 9.3923e-04
Loss = 1.4313e-03, PNorm = 106.8199, GNorm = 0.0347, lr_0 = 9.3922e-04
Validation auc = 0.701482
Epoch 1222
Validation auc = 0.705855
Epoch 1223
Validation auc = 0.706347
Epoch 1224
Validation auc = 0.707140
Epoch 1225
Validation auc = 0.709080
Epoch 1226
Loss = 7.2194e-04, PNorm = 106.9048, GNorm = 0.0149, lr_0 = 9.3900e-04
Validation auc = 0.709381
Epoch 1227
Validation auc = 0.711213
Epoch 1228
Validation auc = 0.710529
Epoch 1229
Validation auc = 0.712197
Epoch 1230
Validation auc = 0.715395
Epoch 1231
Loss = 2.6751e-03, PNorm = 107.0052, GNorm = 0.0423, lr_0 = 9.3875e-04
Validation auc = 0.718347
Epoch 1232
Validation auc = 0.718183
Epoch 1233
Validation auc = 0.718101
Epoch 1234
Validation auc = 0.718456
Epoch 1235
Loss = 3.0431e-03, PNorm = 107.1035, GNorm = 0.0375, lr_0 = 9.3853e-04
Loss = 2.0178e-04, PNorm = 107.1095, GNorm = 0.0055, lr_0 = 9.3852e-04
Validation auc = 0.719550
Epoch 1236
Validation auc = 0.716980
Epoch 1237
Validation auc = 0.716679
Epoch 1238
Validation auc = 0.716160
Epoch 1239
Validation auc = 0.716570
Epoch 1240
Loss = 3.4364e-03, PNorm = 107.1678, GNorm = 0.1855, lr_0 = 9.3828e-04
Loss = 1.2064e-04, PNorm = 107.1723, GNorm = 0.0037, lr_0 = 9.3827e-04
Validation auc = 0.716734
Epoch 1241
Validation auc = 0.717335
Epoch 1242
Validation auc = 0.717718
Epoch 1243
Validation auc = 0.716133
Epoch 1244
Validation auc = 0.714247
Epoch 1245
Loss = 2.1272e-03, PNorm = 107.2021, GNorm = 0.1155, lr_0 = 9.3805e-04
Validation auc = 0.713235
Epoch 1246
Validation auc = 0.712989
Epoch 1247
Validation auc = 0.713181
Epoch 1248
Validation auc = 0.714602
Epoch 1249
Loss = 4.0459e-02, PNorm = 107.2208, GNorm = 0.0371, lr_0 = 9.3782e-04
Validation auc = 0.710775
Epoch 1250
Validation auc = 0.708288
Epoch 1251
Validation auc = 0.708452
Epoch 1252
Validation auc = 0.711459
Epoch 1253
Validation auc = 0.717226
Epoch 1254
Loss = 3.1800e-04, PNorm = 107.2490, GNorm = 0.0124, lr_0 = 9.3758e-04
Loss = 3.4330e-05, PNorm = 107.2512, GNorm = 0.0012, lr_0 = 9.3757e-04
Validation auc = 0.721162
Epoch 1255
Validation auc = 0.726055
Epoch 1256
Validation auc = 0.728297
Epoch 1257
Validation auc = 0.722994
Epoch 1258
Validation auc = 0.715969
Epoch 1259
Loss = 4.2666e-04, PNorm = 107.2655, GNorm = 0.0092, lr_0 = 9.3735e-04
Validation auc = 0.711158
Epoch 1260
Validation auc = 0.710065
Epoch 1261
Validation auc = 0.710365
Epoch 1262
Validation auc = 0.707604
Epoch 1263
Validation auc = 0.701564
Epoch 1264
Loss = 9.3426e-04, PNorm = 107.2864, GNorm = 0.0192, lr_0 = 9.3710e-04
Validation auc = 0.698666
Epoch 1265
Validation auc = 0.698748
Epoch 1266
Validation auc = 0.699677
Epoch 1267
Validation auc = 0.700661
Epoch 1268
Loss = 1.7545e-03, PNorm = 107.3174, GNorm = 0.0135, lr_0 = 9.3689e-04
Loss = 1.8115e-01, PNorm = 107.3174, GNorm = 14.1947, lr_0 = 9.3687e-04
Validation auc = 0.694129
Epoch 1269
Validation auc = 0.683578
Epoch 1270
Validation auc = 0.689946
Epoch 1271
Validation auc = 0.695249
Epoch 1272
Validation auc = 0.700443
Epoch 1273
Loss = 7.2208e-03, PNorm = 107.4187, GNorm = 0.3208, lr_0 = 9.3664e-04
Loss = 2.4706e-03, PNorm = 107.4280, GNorm = 0.0546, lr_0 = 9.3662e-04
Validation auc = 0.705554
Epoch 1274
Validation auc = 0.709381
Epoch 1275
Validation auc = 0.705664
Epoch 1276
Validation auc = 0.704242
Epoch 1277
Validation auc = 0.702493
Epoch 1278
Loss = 6.7280e-03, PNorm = 107.5246, GNorm = 0.1405, lr_0 = 9.3641e-04
Validation auc = 0.701837
Epoch 1279
Validation auc = 0.699595
Epoch 1280
Validation auc = 0.698447
Epoch 1281
Validation auc = 0.696725
Epoch 1282
Validation auc = 0.699951
Epoch 1283
Loss = 1.4623e-03, PNorm = 107.6120, GNorm = 0.0211, lr_0 = 9.3616e-04
Validation auc = 0.715121
Epoch 1284
Validation auc = 0.713591
Epoch 1285
Validation auc = 0.707413
Epoch 1286
Validation auc = 0.695878
Epoch 1287
Loss = 2.5956e-03, PNorm = 107.6710, GNorm = 0.0151, lr_0 = 9.3594e-04
Loss = 2.9250e-03, PNorm = 107.6778, GNorm = 0.3413, lr_0 = 9.3592e-04
Validation auc = 0.690247
Epoch 1288
Validation auc = 0.692871
Epoch 1289
Validation auc = 0.697081
Epoch 1290
Validation auc = 0.700743
Epoch 1291
Validation auc = 0.702657
Epoch 1292
Loss = 3.1111e-02, PNorm = 107.7577, GNorm = 1.4926, lr_0 = 9.3571e-04
Validation auc = 0.693418
Epoch 1293
Validation auc = 0.686311
Epoch 1294
Validation auc = 0.678712
Epoch 1295
Validation auc = 0.672097
Epoch 1296
Validation auc = 0.670894
Epoch 1297
Loss = 7.1120e-02, PNorm = 107.8494, GNorm = 1.2403, lr_0 = 9.3546e-04
Validation auc = 0.668544
Epoch 1298
Validation auc = 0.668872
Epoch 1299
Validation auc = 0.672152
Epoch 1300
Validation auc = 0.674995
Epoch 1301
Loss = 1.4743e-01, PNorm = 107.9548, GNorm = 0.0440, lr_0 = 9.3524e-04
Loss = 1.8226e-04, PNorm = 107.9569, GNorm = 0.0068, lr_0 = 9.3523e-04
Validation auc = 0.673518
Epoch 1302
Validation auc = 0.672097
Epoch 1303
Validation auc = 0.668380
Epoch 1304
Validation auc = 0.664935
Epoch 1305
Validation auc = 0.659633
Epoch 1306
Loss = 5.5144e-03, PNorm = 107.9964, GNorm = 0.3488, lr_0 = 9.3499e-04
Loss = 3.9633e-04, PNorm = 107.9998, GNorm = 0.0159, lr_0 = 9.3498e-04
Validation auc = 0.657118
Epoch 1307
Validation auc = 0.656298
Epoch 1308
Validation auc = 0.659961
Epoch 1309
Validation auc = 0.667122
Epoch 1310
Validation auc = 0.674612
Epoch 1311
Loss = 1.9304e-03, PNorm = 108.0340, GNorm = 0.0604, lr_0 = 9.3476e-04
Validation auc = 0.673846
Epoch 1312
Validation auc = 0.671878
Epoch 1313
Validation auc = 0.683796
Epoch 1314
Validation auc = 0.691559
Epoch 1315
Validation auc = 0.694347
Epoch 1316
Loss = 2.7785e-02, PNorm = 108.1387, GNorm = 0.3842, lr_0 = 9.3451e-04
Validation auc = 0.697901
Epoch 1317
Validation auc = 0.702438
Epoch 1318
Validation auc = 0.703422
Epoch 1319
Validation auc = 0.698557
Epoch 1320
Loss = 3.0937e-02, PNorm = 108.2674, GNorm = 0.0610, lr_0 = 9.3430e-04
Loss = 1.8022e-03, PNorm = 108.2739, GNorm = 0.0504, lr_0 = 9.3428e-04
Validation auc = 0.699103
Epoch 1321
Validation auc = 0.695277
Epoch 1322
Validation auc = 0.693527
Epoch 1323
Validation auc = 0.697463
Epoch 1324
Validation auc = 0.700142
Epoch 1325
Loss = 4.7364e-03, PNorm = 108.3412, GNorm = 0.0681, lr_0 = 9.3407e-04
Validation auc = 0.699869
Epoch 1326
Validation auc = 0.699322
Epoch 1327
Validation auc = 0.699486
Epoch 1328
Validation auc = 0.696643
Epoch 1329
Validation auc = 0.694839
Epoch 1330
Loss = 1.1443e-02, PNorm = 108.4006, GNorm = 0.4750, lr_0 = 9.3382e-04
Validation auc = 0.691176
Epoch 1331
Validation auc = 0.688990
Epoch 1332
Validation auc = 0.687678
Epoch 1333
Validation auc = 0.688115
Epoch 1334
Loss = 2.2043e-03, PNorm = 108.4472, GNorm = 0.0272, lr_0 = 9.3360e-04
Loss = 8.7010e-05, PNorm = 108.4505, GNorm = 0.0031, lr_0 = 9.3359e-04
Validation auc = 0.686366
Epoch 1335
Validation auc = 0.685491
Epoch 1336
Validation auc = 0.683250
Epoch 1337
Validation auc = 0.673846
Epoch 1338
Validation auc = 0.665974
Epoch 1339
Loss = 5.6318e-02, PNorm = 108.4901, GNorm = 0.1027, lr_0 = 9.3336e-04
Loss = 4.1875e-03, PNorm = 108.4930, GNorm = 0.1791, lr_0 = 9.3334e-04
Validation auc = 0.662147
Epoch 1340
Validation auc = 0.661218
Epoch 1341
Validation auc = 0.661765
Epoch 1342
Validation auc = 0.658703
Epoch 1343
Validation auc = 0.664990
Epoch 1344
Loss = 6.8677e-02, PNorm = 108.5571, GNorm = 0.5648, lr_0 = 9.3312e-04
Validation auc = 0.674776
Epoch 1345
Validation auc = 0.687131
Epoch 1346
Validation auc = 0.697245
Epoch 1347
Validation auc = 0.702438
Epoch 1348
Validation auc = 0.706866
Epoch 1349
Loss = 1.3326e-02, PNorm = 108.6742, GNorm = 0.2120, lr_0 = 9.3288e-04
Validation auc = 0.710857
Epoch 1350
Validation auc = 0.711131
Epoch 1351
Validation auc = 0.711240
Epoch 1352
Validation auc = 0.710803
Epoch 1353
Loss = 4.8031e-03, PNorm = 108.7511, GNorm = 0.0721, lr_0 = 9.3266e-04
Loss = 1.5373e-03, PNorm = 108.7569, GNorm = 0.0386, lr_0 = 9.3264e-04
Validation auc = 0.711131
Epoch 1354
Validation auc = 0.710256
Epoch 1355
Validation auc = 0.707249
Epoch 1356
Validation auc = 0.702083
Epoch 1357
Validation auc = 0.697272
Epoch 1358
Loss = 1.5112e-02, PNorm = 108.8113, GNorm = 3.0025, lr_0 = 9.3241e-04
Validation auc = 0.695823
Epoch 1359
Validation auc = 0.694347
Epoch 1360
Validation auc = 0.698065
Epoch 1361
Validation auc = 0.698447
Epoch 1362
Validation auc = 0.694074
Epoch 1363
Loss = 6.6285e-04, PNorm = 108.8666, GNorm = 0.0138, lr_0 = 9.3218e-04
Validation auc = 0.695003
Epoch 1364
Validation auc = 0.702548
Epoch 1365
Validation auc = 0.703969
Epoch 1366
Validation auc = 0.703040
Epoch 1367
Loss = 2.9621e-02, PNorm = 108.9341, GNorm = 0.1335, lr_0 = 9.3197e-04
Loss = 1.3953e-03, PNorm = 108.9398, GNorm = 0.0323, lr_0 = 9.3195e-04
Validation auc = 0.702110
Epoch 1368
Validation auc = 0.697627
Epoch 1369
Validation auc = 0.693090
Epoch 1370
Validation auc = 0.692161
Epoch 1371
Validation auc = 0.690028
Epoch 1372
Loss = 3.4782e-03, PNorm = 109.0109, GNorm = 0.0831, lr_0 = 9.3172e-04
Loss = 7.8425e-04, PNorm = 109.0164, GNorm = 0.0311, lr_0 = 9.3170e-04
Validation auc = 0.688170
Epoch 1373
Validation auc = 0.687842
Epoch 1374
Validation auc = 0.689263
Epoch 1375
Validation auc = 0.690958
Epoch 1376
Validation auc = 0.692653
Epoch 1377
Loss = 2.5536e-02, PNorm = 109.0815, GNorm = 1.6292, lr_0 = 9.3149e-04
Validation auc = 0.695331
Epoch 1378
Validation auc = 0.698283
Epoch 1379
Validation auc = 0.699486
Epoch 1380
Validation auc = 0.699869
Epoch 1381
Validation auc = 0.700634
Epoch 1382
Loss = 3.1338e-04, PNorm = 109.1263, GNorm = 0.0082, lr_0 = 9.3124e-04
Validation auc = 0.701236
Epoch 1383
Validation auc = 0.701345
Epoch 1384
Validation auc = 0.701728
Epoch 1385
Validation auc = 0.699595
Epoch 1386
Loss = 3.2148e-03, PNorm = 109.1626, GNorm = 0.1940, lr_0 = 9.3102e-04
Loss = 3.0892e-05, PNorm = 109.1659, GNorm = 0.0019, lr_0 = 9.3101e-04
Validation auc = 0.697081
Epoch 1387
Validation auc = 0.695769
Epoch 1388
Validation auc = 0.694238
Epoch 1389
Validation auc = 0.689837
Epoch 1390
Validation auc = 0.688908
Epoch 1391
Loss = 4.1368e-04, PNorm = 109.2125, GNorm = 0.0127, lr_0 = 9.3078e-04
Validation auc = 0.687459
Epoch 1392
Validation auc = 0.685682
Epoch 1393
Validation auc = 0.684616
Epoch 1394
Validation auc = 0.684097
Epoch 1395
Validation auc = 0.682839
Epoch 1396
Loss = 4.6204e-03, PNorm = 109.2381, GNorm = 0.2671, lr_0 = 9.3055e-04
Validation auc = 0.680789
Epoch 1397
Validation auc = 0.678985
Epoch 1398
Validation auc = 0.678849
Epoch 1399
Validation auc = 0.680516
Epoch 1400
Loss = 3.4353e-04, PNorm = 109.2631, GNorm = 0.0218, lr_0 = 9.3033e-04
Loss = 4.8551e-05, PNorm = 109.2650, GNorm = 0.0025, lr_0 = 9.3032e-04
Validation auc = 0.680871
Epoch 1401
Validation auc = 0.684234
Epoch 1402
Validation auc = 0.684398
Epoch 1403
Validation auc = 0.686038
Epoch 1404
Validation auc = 0.686830
Epoch 1405
Loss = 1.8804e-03, PNorm = 109.2729, GNorm = 0.0036, lr_0 = 9.3008e-04
Loss = 2.2390e-05, PNorm = 109.2740, GNorm = 0.0008, lr_0 = 9.3007e-04
Validation auc = 0.690384
Epoch 1406
Validation auc = 0.692243
Epoch 1407
Validation auc = 0.696261
Epoch 1408
Validation auc = 0.697518
Epoch 1409
Validation auc = 0.699322
Epoch 1410
Loss = 1.1845e-03, PNorm = 109.3066, GNorm = 0.0465, lr_0 = 9.2985e-04
Validation auc = 0.699486
Epoch 1411
Validation auc = 0.699267
Epoch 1412
Validation auc = 0.699049
Epoch 1413
Validation auc = 0.698939
Epoch 1414
Validation auc = 0.699213
Epoch 1415
Loss = 3.9854e-02, PNorm = 109.3411, GNorm = 0.7347, lr_0 = 9.2961e-04
Validation auc = 0.695933
Epoch 1416
Validation auc = 0.690302
Epoch 1417
Validation auc = 0.689181
Epoch 1418
Validation auc = 0.687268
Epoch 1419
Loss = 1.5115e-03, PNorm = 109.3609, GNorm = 0.0409, lr_0 = 9.2939e-04
Loss = 3.1339e-03, PNorm = 109.3626, GNorm = 0.0936, lr_0 = 9.2938e-04
Validation auc = 0.685819
Epoch 1420
Validation auc = 0.685737
Epoch 1421
Validation auc = 0.688306
Epoch 1422
Validation auc = 0.690411
Epoch 1423
Validation auc = 0.692024
Epoch 1424
Loss = 1.5776e-02, PNorm = 109.3861, GNorm = 0.0190, lr_0 = 9.2914e-04
Validation auc = 0.693391
Epoch 1425
Validation auc = 0.693883
Epoch 1426
Validation auc = 0.693992
Epoch 1427
Validation auc = 0.693883
Epoch 1428
Validation auc = 0.694156
Epoch 1429
Loss = 1.1678e-04, PNorm = 109.4002, GNorm = 0.0034, lr_0 = 9.2891e-04
Validation auc = 0.693664
Epoch 1430
Validation auc = 0.693746
Epoch 1431
Validation auc = 0.695085
Epoch 1432
Validation auc = 0.695605
Epoch 1433
Loss = 4.4714e-04, PNorm = 109.3867, GNorm = 0.0037, lr_0 = 9.2868e-04
Validation auc = 0.695386
Epoch 1434
Validation auc = 0.698338
Epoch 1435
Validation auc = 0.698557
Epoch 1436
Validation auc = 0.698502
Epoch 1437
Validation auc = 0.696479
Epoch 1438
Loss = 2.6749e-03, PNorm = 109.3971, GNorm = 0.1705, lr_0 = 9.2845e-04
Loss = 3.2483e-05, PNorm = 109.3989, GNorm = 0.0016, lr_0 = 9.2844e-04
Validation auc = 0.695659
Epoch 1439
Validation auc = 0.694785
Epoch 1440
Validation auc = 0.694621
Epoch 1441
Validation auc = 0.694949
Epoch 1442
Validation auc = 0.695659
Epoch 1443
Loss = 5.1856e-04, PNorm = 109.4237, GNorm = 0.0130, lr_0 = 9.2822e-04
Validation auc = 0.696698
Epoch 1444
Validation auc = 0.698119
Epoch 1445
Validation auc = 0.700033
Epoch 1446
Validation auc = 0.700251
Epoch 1447
Validation auc = 0.700579
Epoch 1448
Loss = 3.3752e-04, PNorm = 109.4385, GNorm = 0.0119, lr_0 = 9.2798e-04
Validation auc = 0.700579
Epoch 1449
Validation auc = 0.700634
Epoch 1450
Validation auc = 0.701017
Epoch 1451
Validation auc = 0.701454
Epoch 1452
Loss = 1.6786e-03, PNorm = 109.4516, GNorm = 0.0477, lr_0 = 9.2776e-04
Loss = 7.5886e-05, PNorm = 109.4527, GNorm = 0.0030, lr_0 = 9.2775e-04
Validation auc = 0.701290
Epoch 1453
Validation auc = 0.698639
Epoch 1454
Validation auc = 0.698611
Epoch 1455
Validation auc = 0.698967
Epoch 1456
Validation auc = 0.698912
Epoch 1457
Loss = 2.1873e-04, PNorm = 109.4665, GNorm = 0.0064, lr_0 = 9.2752e-04
Loss = 5.1275e-05, PNorm = 109.4673, GNorm = 0.0020, lr_0 = 9.2750e-04
Validation auc = 0.699076
Epoch 1458
Validation auc = 0.699103
Epoch 1459
Validation auc = 0.699349
Epoch 1460
Validation auc = 0.699349
Epoch 1461
Validation auc = 0.699076
Epoch 1462
Loss = 7.3404e-05, PNorm = 109.4766, GNorm = 0.0023, lr_0 = 9.2729e-04
Validation auc = 0.699021
Epoch 1463
Validation auc = 0.699513
Epoch 1464
Validation auc = 0.699623
Epoch 1465
Validation auc = 0.699513
Epoch 1466
Loss = 5.5265e-02, PNorm = 109.4764, GNorm = 0.0263, lr_0 = 9.2706e-04
Validation auc = 0.696233
Epoch 1467
Validation auc = 0.693035
Epoch 1468
Validation auc = 0.691887
Epoch 1469
Validation auc = 0.691040
Epoch 1470
Validation auc = 0.691176
Epoch 1471
Loss = 1.1463e-03, PNorm = 109.4813, GNorm = 0.0254, lr_0 = 9.2683e-04
Loss = 3.6593e-04, PNorm = 109.4825, GNorm = 0.0145, lr_0 = 9.2681e-04
Validation auc = 0.690848
Epoch 1472
Validation auc = 0.690766
Epoch 1473
Validation auc = 0.690438
Epoch 1474
Validation auc = 0.690220
Epoch 1475
Validation auc = 0.688634
Epoch 1476
Loss = 3.3782e-04, PNorm = 109.4997, GNorm = 0.0090, lr_0 = 9.2660e-04
Validation auc = 0.687705
Epoch 1477
Validation auc = 0.685901
Epoch 1478
Validation auc = 0.684835
Epoch 1479
Validation auc = 0.685190
Epoch 1480
Validation auc = 0.684972
Epoch 1481
Loss = 4.7939e-04, PNorm = 109.5178, GNorm = 0.0130, lr_0 = 9.2635e-04
Validation auc = 0.684698
Epoch 1482
Validation auc = 0.684616
Epoch 1483
Validation auc = 0.684753
Epoch 1484
Validation auc = 0.685081
Epoch 1485
Loss = 3.8987e-04, PNorm = 109.5324, GNorm = 0.0054, lr_0 = 9.2614e-04
Loss = 1.1191e-03, PNorm = 109.5333, GNorm = 0.0348, lr_0 = 9.2612e-04
Validation auc = 0.685464
Epoch 1486
Validation auc = 0.685300
Epoch 1487
Validation auc = 0.685300
Epoch 1488
Validation auc = 0.685136
Epoch 1489
Validation auc = 0.685464
Epoch 1490
Loss = 1.5189e-04, PNorm = 109.5429, GNorm = 0.0082, lr_0 = 9.2589e-04
Loss = 5.9775e-05, PNorm = 109.5434, GNorm = 0.0023, lr_0 = 9.2587e-04
Validation auc = 0.685600
Epoch 1491
Validation auc = 0.685655
Epoch 1492
Validation auc = 0.685764
Epoch 1493
Validation auc = 0.685737
Epoch 1494
Validation auc = 0.685491
Epoch 1495
Loss = 2.0272e-04, PNorm = 109.5484, GNorm = 0.0050, lr_0 = 9.2566e-04
Validation auc = 0.685272
Epoch 1496
Validation auc = 0.685163
Epoch 1497
Validation auc = 0.685190
Epoch 1498
Validation auc = 0.685382
Epoch 1499
Loss = 2.2122e-04, PNorm = 109.5528, GNorm = 0.0117, lr_0 = 9.2543e-04
Validation auc = 0.685327
Epoch 1500
Validation auc = 0.685518
Epoch 1501
Validation auc = 0.686502
Epoch 1502
Validation auc = 0.686940
Epoch 1503
Validation auc = 0.687650
Epoch 1504
Loss = 7.9287e-05, PNorm = 109.5589, GNorm = 0.0032, lr_0 = 9.2520e-04
Loss = 8.6325e-05, PNorm = 109.5592, GNorm = 0.0031, lr_0 = 9.2518e-04
Validation auc = 0.687623
Epoch 1505
Validation auc = 0.687514
Epoch 1506
Validation auc = 0.687568
Epoch 1507
Validation auc = 0.687623
Epoch 1508
Validation auc = 0.683906
Epoch 1509
Loss = 1.2740e-04, PNorm = 109.5621, GNorm = 0.0043, lr_0 = 9.2497e-04
Validation auc = 0.681336
Epoch 1510
Validation auc = 0.678821
Epoch 1511
Validation auc = 0.677865
Epoch 1512
Validation auc = 0.677291
Epoch 1513
Validation auc = 0.677099
Epoch 1514
Loss = 4.3457e-04, PNorm = 109.5671, GNorm = 0.0163, lr_0 = 9.2472e-04
Validation auc = 0.677318
Epoch 1515
Validation auc = 0.677427
Epoch 1516
Validation auc = 0.677919
Epoch 1517
Validation auc = 0.679313
Epoch 1518
Loss = 7.0385e-03, PNorm = 109.5732, GNorm = 0.0021, lr_0 = 9.2451e-04
Loss = 5.3697e-05, PNorm = 109.5738, GNorm = 0.0031, lr_0 = 9.2449e-04
Validation auc = 0.677318
Epoch 1519
Validation auc = 0.676361
Epoch 1520
Validation auc = 0.676006
Epoch 1521
Validation auc = 0.675733
Epoch 1522
Validation auc = 0.675897
Epoch 1523
Loss = 4.2505e-04, PNorm = 109.5815, GNorm = 0.0591, lr_0 = 9.2427e-04
Loss = 8.1259e-06, PNorm = 109.5819, GNorm = 0.0004, lr_0 = 9.2425e-04
Validation auc = 0.675951
Epoch 1524
Validation auc = 0.676799
Epoch 1525
Validation auc = 0.677564
Epoch 1526
Validation auc = 0.678056
Epoch 1527
Validation auc = 0.679095
Epoch 1528
Loss = 1.8925e-05, PNorm = 109.5877, GNorm = 0.0006, lr_0 = 9.2404e-04
Validation auc = 0.679723
Epoch 1529
Validation auc = 0.680161
Epoch 1530
Validation auc = 0.680762
Epoch 1531
Validation auc = 0.681090
Epoch 1532
Validation auc = 0.681637
Epoch 1533
Loss = 6.5367e-05, PNorm = 109.5922, GNorm = 0.0026, lr_0 = 9.2379e-04
Validation auc = 0.681773
Epoch 1534
Validation auc = 0.681664
Epoch 1535
Validation auc = 0.681883
Epoch 1536
Validation auc = 0.682211
Epoch 1537
Loss = 1.2140e-04, PNorm = 109.5951, GNorm = 0.0054, lr_0 = 9.2358e-04
Loss = 1.9471e-06, PNorm = 109.5953, GNorm = 0.0001, lr_0 = 9.2356e-04
Validation auc = 0.682156
Epoch 1538
Validation auc = 0.682156
Epoch 1539
Validation auc = 0.682484
Epoch 1540
Validation auc = 0.681363
Epoch 1541
Validation auc = 0.678411
Epoch 1542
Loss = 1.7532e-04, PNorm = 109.5945, GNorm = 0.0054, lr_0 = 9.2335e-04
Validation auc = 0.673163
Epoch 1543
Validation auc = 0.669227
Epoch 1544
Validation auc = 0.667478
Epoch 1545
Validation auc = 0.667068
Epoch 1546
Validation auc = 0.668926
Epoch 1547
Loss = 2.1092e-04, PNorm = 109.6233, GNorm = 0.0077, lr_0 = 9.2310e-04
Validation auc = 0.670320
Epoch 1548
Validation auc = 0.671496
Epoch 1549
Validation auc = 0.672015
Epoch 1550
Validation auc = 0.672644
Epoch 1551
Loss = 1.2763e-04, PNorm = 109.6447, GNorm = 0.0047, lr_0 = 9.2289e-04
Loss = 1.1921e-07, PNorm = 109.6457, GNorm = 0.0000, lr_0 = 9.2287e-04
Validation auc = 0.673354
Epoch 1552
Validation auc = 0.673682
Epoch 1553
Validation auc = 0.674284
Epoch 1554
Validation auc = 0.674530
Epoch 1555
Validation auc = 0.674913
Epoch 1556
Loss = 8.7009e-05, PNorm = 109.6543, GNorm = 0.0006, lr_0 = 9.2264e-04
Loss = 6.1988e-06, PNorm = 109.6547, GNorm = 0.0003, lr_0 = 9.2263e-04
Validation auc = 0.675295
Epoch 1557
Validation auc = 0.675623
Epoch 1558
Validation auc = 0.675787
Epoch 1559
Validation auc = 0.675897
Epoch 1560
Validation auc = 0.675869
Epoch 1561
Loss = 1.1932e-05, PNorm = 109.6586, GNorm = 0.0005, lr_0 = 9.2242e-04
Validation auc = 0.675869
Epoch 1562
Validation auc = 0.676744
Epoch 1563
Validation auc = 0.676744
Epoch 1564
Validation auc = 0.677209
Epoch 1565
Validation auc = 0.676881
Epoch 1566
Loss = 1.9789e-04, PNorm = 109.6713, GNorm = 0.0066, lr_0 = 9.2217e-04
Validation auc = 0.676662
Epoch 1567
Validation auc = 0.676197
Epoch 1568
Validation auc = 0.676061
Epoch 1569
Validation auc = 0.676197
Epoch 1570
Loss = 1.3131e-04, PNorm = 109.6821, GNorm = 0.0060, lr_0 = 9.2196e-04
Loss = 8.1321e-05, PNorm = 109.6828, GNorm = 0.0037, lr_0 = 9.2194e-04
Validation auc = 0.676525
Epoch 1571
Validation auc = 0.676689
Epoch 1572
Validation auc = 0.676799
Epoch 1573
Validation auc = 0.677072
Epoch 1574
Validation auc = 0.677236
Epoch 1575
Loss = 1.6121e-04, PNorm = 109.6888, GNorm = 0.0121, lr_0 = 9.2173e-04
Validation auc = 0.677400
Epoch 1576
Validation auc = 0.677564
Epoch 1577
Validation auc = 0.677701
Epoch 1578
Validation auc = 0.677646
Epoch 1579
Validation auc = 0.677974
Epoch 1580
Loss = 6.6448e-05, PNorm = 109.6946, GNorm = 0.0019, lr_0 = 9.2148e-04
Validation auc = 0.678083
Epoch 1581
Validation auc = 0.678165
Epoch 1582
Validation auc = 0.678275
Epoch 1583
Validation auc = 0.678767
Epoch 1584
Loss = 5.3376e-05, PNorm = 109.6983, GNorm = 0.0030, lr_0 = 9.2127e-04
Loss = 3.5821e-05, PNorm = 109.6985, GNorm = 0.0013, lr_0 = 9.2125e-04
Validation auc = 0.678657
Epoch 1585
Validation auc = 0.678657
Epoch 1586
Validation auc = 0.678712
Epoch 1587
Validation auc = 0.676443
Epoch 1588
Validation auc = 0.674366
Epoch 1589
Loss = 2.0734e-03, PNorm = 109.6982, GNorm = 0.0361, lr_0 = 9.2103e-04
Loss = 2.3741e-05, PNorm = 109.6987, GNorm = 0.0022, lr_0 = 9.2101e-04
Validation auc = 0.674557
Epoch 1590
Validation auc = 0.677427
Epoch 1591
Validation auc = 0.678985
Epoch 1592
Validation auc = 0.680953
Epoch 1593
Validation auc = 0.682101
Epoch 1594
Loss = 1.9603e-04, PNorm = 109.7038, GNorm = 0.0225, lr_0 = 9.2080e-04
Validation auc = 0.682047
Epoch 1595
Validation auc = 0.681609
Epoch 1596
Validation auc = 0.680598
Epoch 1597
Validation auc = 0.679833
Epoch 1598
Validation auc = 0.679286
Epoch 1599
Loss = 6.0006e-04, PNorm = 109.7121, GNorm = 0.0152, lr_0 = 9.2055e-04
Validation auc = 0.679013
Epoch 1600
Validation auc = 0.679833
Epoch 1601
Validation auc = 0.680735
Epoch 1602
Validation auc = 0.681336
Epoch 1603
Loss = 4.7964e-04, PNorm = 109.7188, GNorm = 0.0092, lr_0 = 9.2034e-04
Loss = 8.3446e-07, PNorm = 109.7192, GNorm = 0.0000, lr_0 = 9.2032e-04
Validation auc = 0.682375
Epoch 1604
Validation auc = 0.682593
Epoch 1605
Validation auc = 0.682511
Epoch 1606
Validation auc = 0.682429
Epoch 1607
Validation auc = 0.683277
Epoch 1608
Loss = 9.1347e-04, PNorm = 109.7286, GNorm = 0.0033, lr_0 = 9.2010e-04
Validation auc = 0.683742
Epoch 1609
Validation auc = 0.683906
Epoch 1610
Validation auc = 0.683851
Epoch 1611
Validation auc = 0.683578
Epoch 1612
Validation auc = 0.684015
Epoch 1613
Loss = 4.5955e-03, PNorm = 109.7381, GNorm = 0.1235, lr_0 = 9.1987e-04
Validation auc = 0.683851
Epoch 1614
Validation auc = 0.684015
Epoch 1615
Validation auc = 0.683441
Epoch 1616
Validation auc = 0.683250
Epoch 1617
Loss = 6.8806e-04, PNorm = 109.7484, GNorm = 0.0451, lr_0 = 9.1966e-04
Loss = 1.5676e-05, PNorm = 109.7492, GNorm = 0.0010, lr_0 = 9.1964e-04
Validation auc = 0.682757
Epoch 1618
Validation auc = 0.683496
Epoch 1619
Validation auc = 0.684070
Epoch 1620
Validation auc = 0.684562
Epoch 1621
Validation auc = 0.684671
Epoch 1622
Loss = 5.0373e-05, PNorm = 109.7556, GNorm = 0.0023, lr_0 = 9.1941e-04
Loss = 5.7618e-07, PNorm = 109.7560, GNorm = 0.0000, lr_0 = 9.1939e-04
Validation auc = 0.684999
Epoch 1623
Validation auc = 0.685327
Epoch 1624
Validation auc = 0.685546
Epoch 1625
Validation auc = 0.683359
Epoch 1626
Validation auc = 0.681965
Epoch 1627
Loss = 1.0023e-05, PNorm = 109.7598, GNorm = 0.0003, lr_0 = 9.1918e-04
Validation auc = 0.680079
Epoch 1628
Validation auc = 0.678821
Epoch 1629
Validation auc = 0.679477
Epoch 1630
Validation auc = 0.679013
Epoch 1631
Validation auc = 0.680215
Epoch 1632
Loss = 1.9624e-03, PNorm = 109.7892, GNorm = 0.1359, lr_0 = 9.1894e-04
Validation auc = 0.680844
Epoch 1633
Validation auc = 0.681691
Epoch 1634
Validation auc = 0.682703
Epoch 1635
Validation auc = 0.684288
Epoch 1636
Loss = 2.3458e-04, PNorm = 109.8228, GNorm = 0.0155, lr_0 = 9.1873e-04
Loss = 4.4460e-05, PNorm = 109.8246, GNorm = 0.0019, lr_0 = 9.1871e-04
Validation auc = 0.684917
Epoch 1637
Validation auc = 0.685354
Epoch 1638
Validation auc = 0.685901
Epoch 1639
Validation auc = 0.686420
Epoch 1640
Validation auc = 0.686366
Epoch 1641
Loss = 5.4774e-04, PNorm = 109.8420, GNorm = 0.0019, lr_0 = 9.1848e-04
Validation auc = 0.687322
Epoch 1642
Validation auc = 0.687760
Epoch 1643
Validation auc = 0.687787
Epoch 1644
Validation auc = 0.684070
Epoch 1645
Validation auc = 0.686065
Epoch 1646
Loss = 2.8248e-02, PNorm = 109.8686, GNorm = 2.1922, lr_0 = 9.1825e-04
Validation auc = 0.675733
Epoch 1647
Validation auc = 0.669036
Epoch 1648
Validation auc = 0.667942
Epoch 1649
Validation auc = 0.670730
Epoch 1650
Loss = 4.9012e-03, PNorm = 109.9295, GNorm = 0.0135, lr_0 = 9.1804e-04
Loss = 8.5422e-05, PNorm = 109.9334, GNorm = 0.0046, lr_0 = 9.1803e-04
Validation auc = 0.672972
Epoch 1651
Validation auc = 0.673163
Epoch 1652
Validation auc = 0.674667
Epoch 1653
Validation auc = 0.676771
Epoch 1654
Validation auc = 0.678411
Epoch 1655
Loss = 1.7125e-04, PNorm = 109.9734, GNorm = 0.0039, lr_0 = 9.1780e-04
Loss = 1.5497e-06, PNorm = 109.9751, GNorm = 0.0001, lr_0 = 9.1778e-04
Validation auc = 0.678985
Epoch 1656
Validation auc = 0.679395
Epoch 1657
Validation auc = 0.679505
Epoch 1658
Validation auc = 0.679887
Epoch 1659
Validation auc = 0.679505
Epoch 1660
Loss = 4.9920e-05, PNorm = 109.9960, GNorm = 0.0014, lr_0 = 9.1757e-04
Validation auc = 0.678575
Epoch 1661
Validation auc = 0.678521
Epoch 1662
Validation auc = 0.679204
Epoch 1663
Validation auc = 0.682457
Epoch 1664
Validation auc = 0.684234
Epoch 1665
Loss = 2.4614e-04, PNorm = 110.0127, GNorm = 0.0090, lr_0 = 9.1733e-04
Validation auc = 0.685983
Epoch 1666
Validation auc = 0.686776
Epoch 1667
Validation auc = 0.687404
Epoch 1668
Validation auc = 0.687814
Epoch 1669
Loss = 3.3598e-04, PNorm = 110.0225, GNorm = 0.0333, lr_0 = 9.1712e-04
Loss = 3.9537e-06, PNorm = 110.0233, GNorm = 0.0002, lr_0 = 9.1710e-04
Validation auc = 0.687842
Epoch 1670
Validation auc = 0.687705
Epoch 1671
Validation auc = 0.687705
Epoch 1672
Validation auc = 0.687322
Epoch 1673
Validation auc = 0.687213
Epoch 1674
Loss = 1.0603e-03, PNorm = 110.0346, GNorm = 0.0070, lr_0 = 9.1687e-04
Validation auc = 0.687486
Epoch 1675
Validation auc = 0.688006
Epoch 1676
Validation auc = 0.687842
Epoch 1677
Validation auc = 0.687623
Epoch 1678
Validation auc = 0.687705
Epoch 1679
Loss = 3.2134e-04, PNorm = 110.0454, GNorm = 0.0117, lr_0 = 9.1664e-04
Validation auc = 0.687596
Epoch 1680
Validation auc = 0.687377
Epoch 1681
Validation auc = 0.688142
Epoch 1682
Validation auc = 0.688744
Epoch 1683
Loss = 1.0630e-04, PNorm = 110.0547, GNorm = 0.0019, lr_0 = 9.1642e-04
Validation auc = 0.688552
Epoch 1684
Validation auc = 0.689236
Epoch 1685
Validation auc = 0.689509
Epoch 1686
Validation auc = 0.689263
Epoch 1687
Validation auc = 0.689536
Epoch 1688
Loss = 1.7699e-04, PNorm = 110.0635, GNorm = 0.0098, lr_0 = 9.1619e-04
Loss = 3.8567e-04, PNorm = 110.0641, GNorm = 0.0201, lr_0 = 9.1617e-04
Validation auc = 0.689427
Epoch 1689
Validation auc = 0.689290
Epoch 1690
Validation auc = 0.688798
Epoch 1691
Validation auc = 0.688662
Epoch 1692
Validation auc = 0.688607
Epoch 1693
Loss = 1.3921e-04, PNorm = 110.0721, GNorm = 0.0034, lr_0 = 9.1596e-04
Validation auc = 0.688744
Epoch 1694
Validation auc = 0.688744
Epoch 1695
Validation auc = 0.688634
Epoch 1696
Validation auc = 0.688580
Epoch 1697
Validation auc = 0.688525
Epoch 1698
Loss = 8.0656e-04, PNorm = 110.0782, GNorm = 0.0318, lr_0 = 9.1572e-04
Validation auc = 0.688470
Epoch 1699
Validation auc = 0.688252
Epoch 1700
Validation auc = 0.685190
Epoch 1701
Validation auc = 0.682949
Epoch 1702
Loss = 2.0419e-04, PNorm = 110.0862, GNorm = 0.0017, lr_0 = 9.1551e-04
Loss = 1.5100e-06, PNorm = 110.0868, GNorm = 0.0001, lr_0 = 9.1549e-04
Validation auc = 0.681008
Epoch 1703
Validation auc = 0.679641
Epoch 1704
Validation auc = 0.680133
Epoch 1705
Validation auc = 0.682129
Epoch 1706
Validation auc = 0.682949
Epoch 1707
Loss = 1.0312e-04, PNorm = 110.0990, GNorm = 0.0016, lr_0 = 9.1526e-04
Loss = 4.6923e-05, PNorm = 110.0998, GNorm = 0.0029, lr_0 = 9.1525e-04
Validation auc = 0.684097
Epoch 1708
Validation auc = 0.684206
Epoch 1709
Validation auc = 0.684698
Epoch 1710
Validation auc = 0.685081
Epoch 1711
Validation auc = 0.685573
Epoch 1712
Loss = 5.3691e-05, PNorm = 110.1064, GNorm = 0.0014, lr_0 = 9.1504e-04
Validation auc = 0.686010
Epoch 1713
Validation auc = 0.685026
Epoch 1714
Validation auc = 0.684726
Epoch 1715
Validation auc = 0.684616
Epoch 1716
Loss = 1.4265e-04, PNorm = 110.1162, GNorm = 0.0010, lr_0 = 9.1481e-04
Validation auc = 0.684534
Epoch 1717
Validation auc = 0.684507
Epoch 1718
Validation auc = 0.684206
Epoch 1719
Validation auc = 0.684206
Epoch 1720
Validation auc = 0.684425
Epoch 1721
Loss = 9.7859e-05, PNorm = 110.1230, GNorm = 0.0041, lr_0 = 9.1458e-04
Loss = 2.6822e-06, PNorm = 110.1234, GNorm = 0.0003, lr_0 = 9.1457e-04
Validation auc = 0.684480
Epoch 1722
Validation auc = 0.684644
Epoch 1723
Validation auc = 0.676908
Epoch 1724
Validation auc = 0.672917
Epoch 1725
Validation auc = 0.672234
Epoch 1726
Loss = 4.5807e-05, PNorm = 110.1414, GNorm = 0.0017, lr_0 = 9.1436e-04
Validation auc = 0.670758
Epoch 1727
Validation auc = 0.670512
Epoch 1728
Validation auc = 0.669555
Epoch 1729
Validation auc = 0.669582
Epoch 1730
Validation auc = 0.669145
Epoch 1731
Loss = 7.2954e-05, PNorm = 110.1798, GNorm = 0.0030, lr_0 = 9.1411e-04
Validation auc = 0.668216
Epoch 1732
Validation auc = 0.668489
Epoch 1733
Validation auc = 0.671004
Epoch 1734
Validation auc = 0.672808
Epoch 1735
Loss = 2.8484e-04, PNorm = 110.2014, GNorm = 0.0029, lr_0 = 9.1390e-04
Loss = 4.5892e-04, PNorm = 110.2031, GNorm = 0.0137, lr_0 = 9.1389e-04
Validation auc = 0.673409
Epoch 1736
Validation auc = 0.674448
Epoch 1737
Validation auc = 0.674749
Epoch 1738
Validation auc = 0.674257
Epoch 1739
Validation auc = 0.674831
Epoch 1740
Loss = 1.6431e-03, PNorm = 110.2257, GNorm = 0.1322, lr_0 = 9.1366e-04
Loss = 2.1259e-06, PNorm = 110.2276, GNorm = 0.0001, lr_0 = 9.1364e-04
Validation auc = 0.676279
Epoch 1741
Validation auc = 0.678275
Epoch 1742
Validation auc = 0.680215
Epoch 1743
Validation auc = 0.682156
Epoch 1744
Validation auc = 0.683714
Epoch 1745
Loss = 3.3092e-04, PNorm = 110.2494, GNorm = 0.0081, lr_0 = 9.1343e-04
Validation auc = 0.685245
Epoch 1746
Validation auc = 0.685518
Epoch 1747
Validation auc = 0.685026
Epoch 1748
Validation auc = 0.684589
Epoch 1749
Loss = 3.4401e-03, PNorm = 110.2639, GNorm = 0.9298, lr_0 = 9.1320e-04
Validation auc = 0.684261
Epoch 1750
Validation auc = 0.681008
Epoch 1751
Validation auc = 0.679013
Epoch 1752
Validation auc = 0.677837
Epoch 1753
Validation auc = 0.678083
Epoch 1754
Loss = 2.8335e-04, PNorm = 110.2865, GNorm = 0.0190, lr_0 = 9.1298e-04
Loss = 5.8610e-06, PNorm = 110.2876, GNorm = 0.0005, lr_0 = 9.1296e-04
Validation auc = 0.677810
Epoch 1755
Validation auc = 0.678029
Epoch 1756
Validation auc = 0.677974
Epoch 1757
Validation auc = 0.678083
Epoch 1758
Validation auc = 0.678275
Epoch 1759
Loss = 1.6146e-04, PNorm = 110.2978, GNorm = 0.0068, lr_0 = 9.1275e-04
Validation auc = 0.678384
Epoch 1760
Validation auc = 0.678548
Epoch 1761
Validation auc = 0.678493
Epoch 1762
Validation auc = 0.678493
Epoch 1763
Validation auc = 0.678657
Epoch 1764
Loss = 3.9117e-05, PNorm = 110.3042, GNorm = 0.0015, lr_0 = 9.1251e-04
Validation auc = 0.678603
Epoch 1765
Validation auc = 0.678657
Epoch 1766
Validation auc = 0.678685
Epoch 1767
Validation auc = 0.678630
Epoch 1768
Loss = 9.3291e-05, PNorm = 110.3078, GNorm = 0.0026, lr_0 = 9.1230e-04
Loss = 1.6669e-05, PNorm = 110.3081, GNorm = 0.0015, lr_0 = 9.1228e-04
Validation auc = 0.678521
Epoch 1769
Validation auc = 0.678521
Epoch 1770
Validation auc = 0.678493
Epoch 1771
Validation auc = 0.678493
Epoch 1772
Validation auc = 0.678603
Epoch 1773
Loss = 9.4321e-05, PNorm = 110.3128, GNorm = 0.0005, lr_0 = 9.1206e-04
Loss = 3.1789e-07, PNorm = 110.3130, GNorm = 0.0000, lr_0 = 9.1204e-04
Validation auc = 0.678603
Epoch 1774
Validation auc = 0.678384
Epoch 1775
Validation auc = 0.678384
Epoch 1776
Validation auc = 0.677837
Epoch 1777
Validation auc = 0.678083
Epoch 1778
Loss = 1.4331e-04, PNorm = 110.3121, GNorm = 0.0052, lr_0 = 9.1183e-04
Validation auc = 0.678083
Epoch 1779
Validation auc = 0.677591
Epoch 1780
Validation auc = 0.677045
Epoch 1781
Validation auc = 0.676881
Epoch 1782
Validation auc = 0.677099
Epoch 1783
Loss = 6.3141e-05, PNorm = 110.3191, GNorm = 0.0022, lr_0 = 9.1159e-04
Validation auc = 0.677154
Epoch 1784
Validation auc = 0.677209
Epoch 1785
Validation auc = 0.677099
Epoch 1786
Validation auc = 0.676881
Epoch 1787
Loss = 5.1756e-04, PNorm = 110.3255, GNorm = 0.0070, lr_0 = 9.1138e-04
Loss = 2.6483e-05, PNorm = 110.3260, GNorm = 0.0014, lr_0 = 9.1136e-04
Validation auc = 0.676990
Epoch 1788
Validation auc = 0.677099
Epoch 1789
Validation auc = 0.677127
Epoch 1790
Validation auc = 0.677291
Epoch 1791
Validation auc = 0.678083
Epoch 1792
Loss = 9.7829e-05, PNorm = 110.3355, GNorm = 0.0036, lr_0 = 9.1115e-04
Validation auc = 0.679559
Epoch 1793
Validation auc = 0.679204
Epoch 1794
Validation auc = 0.680379
Epoch 1795
Validation auc = 0.682265
Epoch 1796
Validation auc = 0.683003
Epoch 1797
Loss = 1.8730e-04, PNorm = 110.3926, GNorm = 0.0060, lr_0 = 9.1091e-04
Validation auc = 0.682703
Epoch 1798
Validation auc = 0.681582
Epoch 1799
Validation auc = 0.681090
Epoch 1800
Validation auc = 0.679696
Epoch 1801
Loss = 4.4659e-02, PNorm = 110.4366, GNorm = 0.0031, lr_0 = 9.1070e-04
Loss = 7.5498e-06, PNorm = 110.4424, GNorm = 0.0003, lr_0 = 9.1068e-04
Validation auc = 0.667396
Epoch 1802
Validation auc = 0.657063
Epoch 1803
Validation auc = 0.646293
Epoch 1804
Validation auc = 0.638339
Epoch 1805
Validation auc = 0.634540
Epoch 1806
Loss = 7.2028e-04, PNorm = 110.5045, GNorm = 0.0354, lr_0 = 9.1046e-04
Loss = 2.7021e-06, PNorm = 110.5071, GNorm = 0.0002, lr_0 = 9.1044e-04
Validation auc = 0.630576
Epoch 1807
Validation auc = 0.628936
Epoch 1808
Validation auc = 0.627706
Epoch 1809
Validation auc = 0.601738
Epoch 1810
Validation auc = 0.629428
Epoch 1811
Loss = 2.1143e-04, PNorm = 110.5854, GNorm = 0.0102, lr_0 = 9.1023e-04
Validation auc = 0.648863
Epoch 1812
Validation auc = 0.638312
Epoch 1813
Validation auc = 0.631424
Epoch 1814
Validation auc = 0.627433
Epoch 1815
Validation auc = 0.655204
Epoch 1816
Loss = 1.4084e-02, PNorm = 111.5508, GNorm = 0.2300, lr_0 = 9.0999e-04
Validation auc = 0.670184
Epoch 1817
Validation auc = 0.668325
Epoch 1818
Validation auc = 0.675651
Epoch 1819
Validation auc = 0.671386
Epoch 1820
Loss = 2.5778e-02, PNorm = 112.2563, GNorm = 0.4354, lr_0 = 9.0978e-04
Loss = 2.2849e-03, PNorm = 112.2951, GNorm = 0.0831, lr_0 = 9.0976e-04
Validation auc = 0.667560
Epoch 1821
Validation auc = 0.659578
Epoch 1822
Validation auc = 0.663295
Epoch 1823
Validation auc = 0.666740
Epoch 1824
Validation auc = 0.660125
Epoch 1825
Loss = 9.0987e-02, PNorm = 112.6526, GNorm = 1.8803, lr_0 = 9.0955e-04
Validation auc = 0.646621
Epoch 1826
Validation auc = 0.625465
Epoch 1827
Validation auc = 0.609884
Epoch 1828
Validation auc = 0.612672
Epoch 1829
Validation auc = 0.623169
Epoch 1830
Loss = 8.7813e-03, PNorm = 112.9276, GNorm = 0.1085, lr_0 = 9.0931e-04
Validation auc = 0.626011
Epoch 1831
Validation auc = 0.632353
Epoch 1832
Validation auc = 0.640280
Epoch 1833
Validation auc = 0.649847
Epoch 1834
Loss = 2.6191e-02, PNorm = 113.1609, GNorm = 0.1659, lr_0 = 9.0910e-04
Loss = 4.7141e-03, PNorm = 113.1804, GNorm = 0.1184, lr_0 = 9.0909e-04
Validation auc = 0.658922
Epoch 1835
Validation auc = 0.664717
Epoch 1836
Validation auc = 0.671332
Epoch 1837
Validation auc = 0.653400
Epoch 1838
Validation auc = 0.678056
Epoch 1839
Loss = 3.3399e-02, PNorm = 113.4910, GNorm = 0.3249, lr_0 = 9.0886e-04
Loss = 7.6813e-04, PNorm = 113.5186, GNorm = 0.0238, lr_0 = 9.0884e-04
Validation auc = 0.730975
Epoch 1840
Validation auc = 0.713153
Epoch 1841
Validation auc = 0.687295
Epoch 1842
Validation auc = 0.676635
Epoch 1843
Validation auc = 0.733217
Epoch 1844
Loss = 9.8265e-03, PNorm = 113.8726, GNorm = 0.2104, lr_0 = 9.0863e-04
Validation auc = 0.738465
Epoch 1845
Validation auc = 0.736387
Epoch 1846
Validation auc = 0.727586
Epoch 1847
Validation auc = 0.714957
Epoch 1848
Validation auc = 0.715832
Epoch 1849
Loss = 7.7885e-03, PNorm = 114.1470, GNorm = 0.3370, lr_0 = 9.0839e-04
Validation auc = 0.711349
Epoch 1850
Validation auc = 0.697135
Epoch 1851
Validation auc = 0.711404
Epoch 1852
Validation auc = 0.695933
Epoch 1853
Loss = 1.1725e-01, PNorm = 114.3758, GNorm = 2.8730, lr_0 = 9.0818e-04
Loss = 2.9250e-03, PNorm = 114.3968, GNorm = 0.1110, lr_0 = 9.0817e-04
Validation auc = 0.691067
Epoch 1854
Validation auc = 0.679860
Epoch 1855
Validation auc = 0.679149
Epoch 1856
Validation auc = 0.671113
Epoch 1857
Validation auc = 0.668052
Epoch 1858
Loss = 5.9121e-02, PNorm = 114.6867, GNorm = 1.3875, lr_0 = 9.0794e-04
Validation auc = 0.662639
Epoch 1859
Validation auc = 0.658703
Epoch 1860
Validation auc = 0.655587
Epoch 1861
Validation auc = 0.647223
Epoch 1862
Validation auc = 0.648863
Epoch 1863
Loss = 6.0540e-03, PNorm = 114.9738, GNorm = 0.1936, lr_0 = 9.0772e-04
Validation auc = 0.659578
Epoch 1864
Validation auc = 0.666685
Epoch 1865
Validation auc = 0.671550
Epoch 1866
Validation auc = 0.669309
Epoch 1867
Loss = 2.7320e-03, PNorm = 115.1470, GNorm = 0.1475, lr_0 = 9.0751e-04
Loss = 8.5443e-05, PNorm = 115.1564, GNorm = 0.0030, lr_0 = 9.0749e-04
Validation auc = 0.671550
Epoch 1868
Validation auc = 0.678603
Epoch 1869
Validation auc = 0.686256
Epoch 1870
Validation auc = 0.690575
Epoch 1871
Validation auc = 0.693254
Epoch 1872
Loss = 1.6062e-03, PNorm = 115.2451, GNorm = 0.0754, lr_0 = 9.0727e-04
Loss = 3.3595e-05, PNorm = 115.2499, GNorm = 0.0014, lr_0 = 9.0725e-04
Validation auc = 0.695331
Epoch 1873
Validation auc = 0.700634
Epoch 1874
Validation auc = 0.703040
Epoch 1875
Validation auc = 0.704078
Epoch 1876
Validation auc = 0.704352
Epoch 1877
Loss = 3.5521e-03, PNorm = 115.3124, GNorm = 0.0783, lr_0 = 9.0704e-04
Validation auc = 0.703969
Epoch 1878
Validation auc = 0.704242
Epoch 1879
Validation auc = 0.704024
Epoch 1880
Validation auc = 0.700361
Epoch 1881
Validation auc = 0.697846
Epoch 1882
Loss = 2.6569e-02, PNorm = 115.3719, GNorm = 0.9807, lr_0 = 9.0680e-04
Validation auc = 0.698666
Epoch 1883
Validation auc = 0.697573
Epoch 1884
Validation auc = 0.699049
Epoch 1885
Validation auc = 0.703477
Epoch 1886
Loss = 6.6688e-03, PNorm = 115.4392, GNorm = 0.1662, lr_0 = 9.0659e-04
Loss = 1.5182e-03, PNorm = 115.4453, GNorm = 0.0423, lr_0 = 9.0657e-04
Validation auc = 0.709326
Epoch 1887
Validation auc = 0.704953
Epoch 1888
Validation auc = 0.701017
Epoch 1889
Validation auc = 0.707413
Epoch 1890
Validation auc = 0.712935
Epoch 1891
Loss = 1.4357e-03, PNorm = 115.5148, GNorm = 0.0168, lr_0 = 9.0635e-04
Validation auc = 0.717691
Epoch 1892
Validation auc = 0.721627
Epoch 1893
Validation auc = 0.724196
Epoch 1894
Validation auc = 0.724688
Epoch 1895
Validation auc = 0.725618
Epoch 1896
Loss = 9.2541e-04, PNorm = 115.5535, GNorm = 0.0193, lr_0 = 9.0612e-04
Validation auc = 0.727039
Epoch 1897
Validation auc = 0.728351
Epoch 1898
Validation auc = 0.728187
Epoch 1899
Validation auc = 0.732561
Epoch 1900
Loss = 4.0323e-03, PNorm = 115.5904, GNorm = 0.0378, lr_0 = 9.0592e-04
Loss = 2.9926e-04, PNorm = 115.5931, GNorm = 0.0109, lr_0 = 9.0590e-04
Validation auc = 0.735567
Epoch 1901
Validation auc = 0.737590
Epoch 1902
Validation auc = 0.739285
Epoch 1903
Validation auc = 0.739996
Epoch 1904
Validation auc = 0.741144
Epoch 1905
Loss = 7.5071e-04, PNorm = 115.6318, GNorm = 0.0281, lr_0 = 9.0567e-04
Loss = 2.8059e-04, PNorm = 115.6340, GNorm = 0.0109, lr_0 = 9.0566e-04
Validation auc = 0.741526
Epoch 1906
Validation auc = 0.742018
Epoch 1907
Validation auc = 0.742456
Epoch 1908
Validation auc = 0.743330
Epoch 1909
Validation auc = 0.744096
Epoch 1910
Loss = 3.3334e-04, PNorm = 115.6642, GNorm = 0.0078, lr_0 = 9.0545e-04
Validation auc = 0.744478
Epoch 1911
Validation auc = 0.744150
Epoch 1912
Validation auc = 0.743768
Epoch 1913
Validation auc = 0.743986
Epoch 1914
Validation auc = 0.744424
Epoch 1915
Loss = 2.1788e-04, PNorm = 115.6903, GNorm = 0.0060, lr_0 = 9.0521e-04
Validation auc = 0.744642
Epoch 1916
Validation auc = 0.744752
Epoch 1917
Validation auc = 0.744916
Epoch 1918
Validation auc = 0.752351
Epoch 1919
Loss = 8.8532e-05, PNorm = 115.6992, GNorm = 0.0023, lr_0 = 9.0500e-04
Loss = 1.3399e-04, PNorm = 115.7013, GNorm = 0.0058, lr_0 = 9.0498e-04
Validation auc = 0.758419
Epoch 1920
Validation auc = 0.760879
Epoch 1921
Validation auc = 0.763066
Epoch 1922
Validation auc = 0.764597
Epoch 1923
Validation auc = 0.765471
Epoch 1924
Loss = 1.6957e-04, PNorm = 115.7379, GNorm = 0.0015, lr_0 = 9.0476e-04
Validation auc = 0.766510
Epoch 1925
Validation auc = 0.766619
Epoch 1926
Validation auc = 0.767002
Epoch 1927
Validation auc = 0.767057
Epoch 1928
Validation auc = 0.767439
Epoch 1929
Loss = 1.0960e-04, PNorm = 115.7547, GNorm = 0.0030, lr_0 = 9.0454e-04
Validation auc = 0.767603
Epoch 1930
Validation auc = 0.767603
Epoch 1931
Validation auc = 0.764323
Epoch 1932
Validation auc = 0.760606
Epoch 1933
Loss = 4.8023e-03, PNorm = 115.7738, GNorm = 0.0026, lr_0 = 9.0431e-04
Validation auc = 0.756178
Epoch 1934
Validation auc = 0.753280
Epoch 1935
Validation auc = 0.738301
Epoch 1936
Validation auc = 0.724962
Epoch 1937
Validation auc = 0.712661
Epoch 1938
Loss = 3.7033e-02, PNorm = 115.8376, GNorm = 1.2554, lr_0 = 9.0409e-04
Loss = 2.8082e-02, PNorm = 115.8429, GNorm = 1.9120, lr_0 = 9.0407e-04
Validation auc = 0.703969
Epoch 1939
Validation auc = 0.703532
Epoch 1940
Validation auc = 0.709217
Epoch 1941
Validation auc = 0.708069
Epoch 1942
Validation auc = 0.703477
Epoch 1943
Loss = 1.2015e-01, PNorm = 115.9872, GNorm = 2.0778, lr_0 = 9.0386e-04
Validation auc = 0.704953
Epoch 1944
Validation auc = 0.705445
Epoch 1945
Validation auc = 0.707249
Epoch 1946
Validation auc = 0.701290
Epoch 1947
Validation auc = 0.696370
Epoch 1948
Loss = 3.5684e-03, PNorm = 116.0968, GNorm = 0.0558, lr_0 = 9.0362e-04
Validation auc = 0.693691
Epoch 1949
Validation auc = 0.691340
Epoch 1950
Validation auc = 0.690247
Epoch 1951
Validation auc = 0.688552
Epoch 1952
Loss = 5.5797e-03, PNorm = 116.1633, GNorm = 0.1110, lr_0 = 9.0341e-04
Loss = 1.9402e-03, PNorm = 116.1690, GNorm = 0.0612, lr_0 = 9.0340e-04
Validation auc = 0.688115
Epoch 1953
Validation auc = 0.687514
Epoch 1954
Validation auc = 0.687022
Epoch 1955
Validation auc = 0.687732
Epoch 1956
Validation auc = 0.687459
Epoch 1957
Loss = 3.9057e-03, PNorm = 116.2393, GNorm = 0.0750, lr_0 = 9.0317e-04
Loss = 1.1894e-03, PNorm = 116.2439, GNorm = 0.0314, lr_0 = 9.0316e-04
Validation auc = 0.687459
Epoch 1958
Validation auc = 0.686967
Epoch 1959
Validation auc = 0.684999
Epoch 1960
Validation auc = 0.677947
Epoch 1961
Validation auc = 0.667286
Epoch 1962
Loss = 2.0795e-01, PNorm = 116.2938, GNorm = 3.1006, lr_0 = 9.0295e-04
Validation auc = 0.659031
Epoch 1963
Validation auc = 0.658922
Epoch 1964
Validation auc = 0.665045
Epoch 1965
Validation auc = 0.671168
Epoch 1966
Loss = 2.7396e-02, PNorm = 116.4176, GNorm = 0.0673, lr_0 = 9.0273e-04
Validation auc = 0.675104
Epoch 1967
Validation auc = 0.676143
Epoch 1968
Validation auc = 0.675869
Epoch 1969
Validation auc = 0.677947
Epoch 1970
Validation auc = 0.679696
Epoch 1971
Loss = 1.0203e-02, PNorm = 116.5162, GNorm = 0.0843, lr_0 = 9.0250e-04
Loss = 9.2723e-04, PNorm = 116.5226, GNorm = 0.0281, lr_0 = 9.0249e-04
Validation auc = 0.682047
Epoch 1972
Validation auc = 0.684507
Epoch 1973
Validation auc = 0.687295
Epoch 1974
Validation auc = 0.690083
Epoch 1975
Validation auc = 0.692106
Epoch 1976
Loss = 3.3893e-03, PNorm = 116.5960, GNorm = 0.1214, lr_0 = 9.0228e-04
Validation auc = 0.691668
Epoch 1977
Validation auc = 0.692051
Epoch 1978
Validation auc = 0.692817
Epoch 1979
Validation auc = 0.689044
Epoch 1980
Validation auc = 0.685710
Epoch 1981
Loss = 7.1075e-05, PNorm = 116.6421, GNorm = 0.0020, lr_0 = 9.0204e-04
Validation auc = 0.684124
Epoch 1982
Validation auc = 0.683031
Epoch 1983
Validation auc = 0.675541
Epoch 1984
Validation auc = 0.669746
Epoch 1985
Loss = 1.8711e-03, PNorm = 116.6701, GNorm = 0.0454, lr_0 = 9.0183e-04
Loss = 5.2078e-04, PNorm = 116.6728, GNorm = 0.0178, lr_0 = 9.0181e-04
Validation auc = 0.666138
Epoch 1986
Validation auc = 0.666576
Epoch 1987
Validation auc = 0.672152
Epoch 1988
Validation auc = 0.677728
Epoch 1989
Validation auc = 0.680461
Epoch 1990
Loss = 5.5501e-03, PNorm = 116.7148, GNorm = 0.3784, lr_0 = 9.0159e-04
Loss = 4.3672e-04, PNorm = 116.7171, GNorm = 0.0173, lr_0 = 9.0157e-04
Validation auc = 0.683523
Epoch 1991
Validation auc = 0.685054
Epoch 1992
Validation auc = 0.688662
Epoch 1993
Validation auc = 0.690192
Epoch 1994
Validation auc = 0.691559
Epoch 1995
Loss = 4.2760e-04, PNorm = 116.7338, GNorm = 0.0090, lr_0 = 9.0137e-04
Validation auc = 0.692489
Epoch 1996
Validation auc = 0.693801
Epoch 1997
Validation auc = 0.694894
Epoch 1998
Validation auc = 0.695987
Epoch 1999
Loss = 3.1660e-04, PNorm = 116.7584, GNorm = 0.0031, lr_0 = 9.0114e-04
Validation auc = 0.697409
Model 0 best validation auc = 0.779002 on epoch 959
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.672188
Ensemble test auc = 0.672188
Fold 6
Splitting data with seed 6
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.453422
Epoch 1
Validation auc = 0.474470
Epoch 2
Validation auc = 0.554614
Epoch 3
Validation auc = 0.505686
Epoch 4
Loss = 6.8666e-01, PNorm = 71.6157, GNorm = 1.0155, lr_0 = 2.0385e-04
Loss = 6.9839e-01, PNorm = 71.6171, GNorm = 3.0873, lr_0 = 2.1077e-04
Validation auc = 0.620490
Epoch 5
Validation auc = 0.543680
Epoch 6
Validation auc = 0.513066
Epoch 7
Validation auc = 0.643068
Epoch 8
Validation auc = 0.556309
Epoch 9
Loss = 7.3089e-01, PNorm = 71.6393, GNorm = 1.0297, lr_0 = 3.0077e-04
Validation auc = 0.656517
Epoch 10
Validation auc = 0.573639
Epoch 11
Validation auc = 0.640389
Epoch 12
Validation auc = 0.560464
Epoch 13
Validation auc = 0.660945
Epoch 14
Loss = 6.7846e-01, PNorm = 71.6818, GNorm = 1.5317, lr_0 = 4.0462e-04
Validation auc = 0.614804
Epoch 15
Validation auc = 0.647223
Epoch 16
Validation auc = 0.638913
Epoch 17
Validation auc = 0.682265
Epoch 18
Loss = 6.7746e-01, PNorm = 71.7343, GNorm = 1.2675, lr_0 = 4.9462e-04
Loss = 7.4034e-01, PNorm = 71.7393, GNorm = 2.0987, lr_0 = 5.0154e-04
Validation auc = 0.658813
Epoch 19
Validation auc = 0.658813
Epoch 20
Validation auc = 0.660070
Epoch 21
Validation auc = 0.659469
Epoch 22
Validation auc = 0.666576
Epoch 23
Loss = 6.3358e-01, PNorm = 71.8187, GNorm = 0.7667, lr_0 = 5.9846e-04
Loss = 7.0008e-01, PNorm = 71.8228, GNorm = 2.2529, lr_0 = 6.0538e-04
Validation auc = 0.680953
Epoch 24
Validation auc = 0.692543
Epoch 25
Validation auc = 0.679860
Epoch 26
Validation auc = 0.682211
Epoch 27
Validation auc = 0.669746
Epoch 28
Loss = 7.5673e-01, PNorm = 71.9184, GNorm = 2.2124, lr_0 = 6.9538e-04
Validation auc = 0.663295
Epoch 29
Validation auc = 0.635906
Epoch 30
Validation auc = 0.649738
Epoch 31
Validation auc = 0.654658
Epoch 32
Validation auc = 0.652799
Epoch 33
Loss = 6.1580e-01, PNorm = 72.0424, GNorm = 0.3270, lr_0 = 7.9923e-04
Validation auc = 0.658157
Epoch 34
Validation auc = 0.637984
Epoch 35
Validation auc = 0.622950
Epoch 36
Validation auc = 0.613274
Epoch 37
Loss = 6.7594e-01, PNorm = 72.1568, GNorm = 0.4093, lr_0 = 8.8923e-04
Loss = 5.8629e-01, PNorm = 72.1675, GNorm = 0.7131, lr_0 = 8.9615e-04
Validation auc = 0.601410
Epoch 38
Validation auc = 0.593976
Epoch 39
Validation auc = 0.601902
Epoch 40
Validation auc = 0.610759
Epoch 41
Validation auc = 0.616827
Epoch 42
Loss = 5.9018e-01, PNorm = 72.3207, GNorm = 0.5007, lr_0 = 9.8615e-04
Validation auc = 0.630221
Epoch 43
Validation auc = 0.643123
Epoch 44
Validation auc = 0.642631
Epoch 45
Validation auc = 0.632353
Epoch 46
Validation auc = 0.615898
Epoch 47
Loss = 4.9239e-01, PNorm = 72.5216, GNorm = 0.4140, lr_0 = 9.9977e-04
Validation auc = 0.564564
Epoch 48
Validation auc = 0.617046
Epoch 49
Validation auc = 0.636398
Epoch 50
Validation auc = 0.631697
Epoch 51
Loss = 6.2902e-01, PNorm = 72.7378, GNorm = 0.6879, lr_0 = 9.9954e-04
Loss = 4.8385e-01, PNorm = 72.7581, GNorm = 1.0900, lr_0 = 9.9952e-04
Validation auc = 0.624645
Epoch 52
Validation auc = 0.604745
Epoch 53
Validation auc = 0.590859
Epoch 54
Validation auc = 0.580363
Epoch 55
Validation auc = 0.580254
Epoch 56
Loss = 5.8567e-01, PNorm = 72.9931, GNorm = 0.6935, lr_0 = 9.9927e-04
Loss = 5.7582e-01, PNorm = 73.0095, GNorm = 0.8754, lr_0 = 9.9926e-04
Validation auc = 0.581019
Epoch 57
Validation auc = 0.539143
Epoch 58
Validation auc = 0.552373
Epoch 59
Validation auc = 0.575661
Epoch 60
Validation auc = 0.594413
Epoch 61
Loss = 6.2448e-01, PNorm = 73.2485, GNorm = 0.4023, lr_0 = 9.9903e-04
Validation auc = 0.617264
Epoch 62
Validation auc = 0.594905
Epoch 63
Validation auc = 0.586541
Epoch 64
Validation auc = 0.584791
Epoch 65
Validation auc = 0.583151
Epoch 66
Loss = 4.9059e-01, PNorm = 73.5254, GNorm = 0.4783, lr_0 = 9.9876e-04
Validation auc = 0.590641
Epoch 67
Validation auc = 0.602394
Epoch 68
Validation auc = 0.619396
Epoch 69
Validation auc = 0.581402
Epoch 70
Loss = 6.8036e-01, PNorm = 73.7586, GNorm = 0.4865, lr_0 = 9.9853e-04
Loss = 6.2169e-01, PNorm = 73.7814, GNorm = 0.8450, lr_0 = 9.9851e-04
Validation auc = 0.557621
Epoch 71
Validation auc = 0.575771
Epoch 72
Validation auc = 0.589001
Epoch 73
Validation auc = 0.586158
Epoch 74
Validation auc = 0.581839
Epoch 75
Loss = 5.5486e-01, PNorm = 74.0352, GNorm = 0.2799, lr_0 = 9.9828e-04
Validation auc = 0.582550
Epoch 76
Validation auc = 0.561448
Epoch 77
Validation auc = 0.546195
Epoch 78
Validation auc = 0.533840
Epoch 79
Validation auc = 0.507162
Epoch 80
Loss = 6.8492e-01, PNorm = 74.3296, GNorm = 0.1630, lr_0 = 9.9802e-04
Validation auc = 0.503827
Epoch 81
Validation auc = 0.515581
Epoch 82
Validation auc = 0.565766
Epoch 83
Validation auc = 0.608517
Epoch 84
Loss = 5.2090e-01, PNorm = 74.6165, GNorm = 1.7680, lr_0 = 9.9779e-04
Loss = 6.5831e-01, PNorm = 74.6393, GNorm = 1.3717, lr_0 = 9.9777e-04
Validation auc = 0.588235
Epoch 85
Validation auc = 0.595233
Epoch 86
Validation auc = 0.594358
Epoch 87
Validation auc = 0.587306
Epoch 88
Validation auc = 0.597420
Epoch 89
Loss = 4.0813e-01, PNorm = 75.0047, GNorm = 2.5834, lr_0 = 9.9752e-04
Loss = 5.3784e-01, PNorm = 75.0276, GNorm = 1.5164, lr_0 = 9.9750e-04
Validation auc = 0.612563
Epoch 90
Validation auc = 0.598404
Epoch 91
Validation auc = 0.605183
Epoch 92
Validation auc = 0.622075
Epoch 93
Validation auc = 0.644763
Epoch 94
Loss = 3.3020e-01, PNorm = 75.3744, GNorm = 0.5193, lr_0 = 9.9727e-04
Validation auc = 0.656626
Epoch 95
Validation auc = 0.648043
Epoch 96
Validation auc = 0.553138
Epoch 97
Validation auc = 0.456101
Epoch 98
Validation auc = 0.436694
Epoch 99
Loss = 6.9128e-01, PNorm = 75.7662, GNorm = 0.1109, lr_0 = 9.9701e-04
Validation auc = 0.570905
Epoch 100
Validation auc = 0.447901
Epoch 101
Validation auc = 0.628963
Epoch 102
Validation auc = 0.552209
Epoch 103
Loss = 6.9551e-01, PNorm = 76.1291, GNorm = 0.2788, lr_0 = 9.9678e-04
Loss = 6.9493e-01, PNorm = 76.1485, GNorm = 0.9486, lr_0 = 9.9676e-04
Validation auc = 0.521703
Epoch 104
Validation auc = 0.536081
Epoch 105
Validation auc = 0.372349
Epoch 106
Validation auc = 0.516920
Epoch 107
Validation auc = 0.597966
Epoch 108
Loss = 6.8786e-01, PNorm = 76.3428, GNorm = 0.1041, lr_0 = 9.9651e-04
Validation auc = 0.557730
Epoch 109
Validation auc = 0.434726
Epoch 110
Validation auc = 0.365023
Epoch 111
Validation auc = 0.430953
Epoch 112
Validation auc = 0.461513
Epoch 113
Loss = 6.3765e-01, PNorm = 76.4891, GNorm = 0.8000, lr_0 = 9.9627e-04
Validation auc = 0.480374
Epoch 114
Validation auc = 0.510442
Epoch 115
Validation auc = 0.585885
Epoch 116
Validation auc = 0.624153
Epoch 117
Loss = 5.8103e-01, PNorm = 76.7323, GNorm = 0.8517, lr_0 = 9.9604e-04
Loss = 6.4618e-01, PNorm = 76.7559, GNorm = 1.6672, lr_0 = 9.9602e-04
Validation auc = 0.611087
Epoch 118
Validation auc = 0.573967
Epoch 119
Validation auc = 0.509458
Epoch 120
Validation auc = 0.568445
Epoch 121
Validation auc = 0.582386
Epoch 122
Loss = 5.7083e-01, PNorm = 77.0342, GNorm = 0.4951, lr_0 = 9.9577e-04
Loss = 5.1301e-01, PNorm = 77.0544, GNorm = 0.4378, lr_0 = 9.9575e-04
Validation auc = 0.566750
Epoch 123
Validation auc = 0.558496
Epoch 124
Validation auc = 0.555981
Epoch 125
Validation auc = 0.569812
Epoch 126
Validation auc = 0.570741
Epoch 127
Loss = 4.9125e-01, PNorm = 77.3172, GNorm = 0.5926, lr_0 = 9.9552e-04
Validation auc = 0.549913
Epoch 128
Validation auc = 0.559862
Epoch 129
Validation auc = 0.564236
Epoch 130
Validation auc = 0.576482
Epoch 131
Validation auc = 0.581675
Epoch 132
Loss = 3.8585e-01, PNorm = 77.7190, GNorm = 0.8528, lr_0 = 9.9526e-04
Validation auc = 0.596326
Epoch 133
Validation auc = 0.594358
Epoch 134
Validation auc = 0.590531
Epoch 135
Validation auc = 0.611469
Epoch 136
Loss = 3.4418e-01, PNorm = 78.0687, GNorm = 2.5392, lr_0 = 9.9503e-04
Loss = 1.4788e-01, PNorm = 78.1007, GNorm = 3.4666, lr_0 = 9.9501e-04
Validation auc = 0.595069
Epoch 137
Validation auc = 0.653236
Epoch 138
Validation auc = 0.654384
Epoch 139
Validation auc = 0.659633
Epoch 140
Validation auc = 0.661601
Epoch 141
Loss = 4.5772e-01, PNorm = 78.5020, GNorm = 2.6967, lr_0 = 9.9477e-04
Validation auc = 0.670676
Epoch 142
Validation auc = 0.684070
Epoch 143
Validation auc = 0.672589
Epoch 144
Validation auc = 0.682047
Epoch 145
Validation auc = 0.680789
Epoch 146
Loss = 1.9081e-01, PNorm = 78.9511, GNorm = 0.6603, lr_0 = 9.9452e-04
Validation auc = 0.673901
Epoch 147
Validation auc = 0.660015
Epoch 148
Validation auc = 0.657610
Epoch 149
Validation auc = 0.660726
Epoch 150
Loss = 1.9841e-01, PNorm = 79.3064, GNorm = 0.9053, lr_0 = 9.9429e-04
Loss = 3.7201e-01, PNorm = 79.3285, GNorm = 5.4432, lr_0 = 9.9427e-04
Validation auc = 0.658703
Epoch 151
Validation auc = 0.656899
Epoch 152
Validation auc = 0.644927
Epoch 153
Validation auc = 0.631752
Epoch 154
Validation auc = 0.642303
Epoch 155
Loss = 1.8625e-01, PNorm = 79.6434, GNorm = 1.8120, lr_0 = 9.9403e-04
Loss = 1.2910e-01, PNorm = 79.6682, GNorm = 1.4868, lr_0 = 9.9401e-04
Validation auc = 0.650886
Epoch 156
Validation auc = 0.665646
Epoch 157
Validation auc = 0.660945
Epoch 158
Validation auc = 0.664717
Epoch 159
Validation auc = 0.619834
Epoch 160
Loss = 2.6323e-01, PNorm = 79.9503, GNorm = 3.5617, lr_0 = 9.9378e-04
Validation auc = 0.595998
Epoch 161
Validation auc = 0.618740
Epoch 162
Validation auc = 0.646731
Epoch 163
Validation auc = 0.663295
Epoch 164
Validation auc = 0.673628
Epoch 165
Loss = 1.9581e-01, PNorm = 80.2613, GNorm = 1.2473, lr_0 = 9.9351e-04
Validation auc = 0.685655
Epoch 166
Validation auc = 0.669637
Epoch 167
Validation auc = 0.665865
Epoch 168
Validation auc = 0.658703
Epoch 169
Loss = 1.8276e-01, PNorm = 80.4796, GNorm = 1.6358, lr_0 = 9.9329e-04
Loss = 4.3596e-01, PNorm = 80.4942, GNorm = 3.5475, lr_0 = 9.9327e-04
Validation auc = 0.660835
Epoch 170
Validation auc = 0.661819
Epoch 171
Validation auc = 0.658813
Epoch 172
Validation auc = 0.659851
Epoch 173
Validation auc = 0.656735
Epoch 174
Loss = 2.0625e-01, PNorm = 80.7120, GNorm = 3.0444, lr_0 = 9.9302e-04
Validation auc = 0.664279
Epoch 175
Validation auc = 0.685163
Epoch 176
Validation auc = 0.696807
Epoch 177
Validation auc = 0.689154
Epoch 178
Validation auc = 0.683250
Epoch 179
Loss = 1.4628e-01, PNorm = 80.9099, GNorm = 1.9355, lr_0 = 9.9277e-04
Validation auc = 0.686967
Epoch 180
Validation auc = 0.663569
Epoch 181
Validation auc = 0.641811
Epoch 182
Validation auc = 0.640936
Epoch 183
Loss = 1.1161e-01, PNorm = 81.1324, GNorm = 6.6075, lr_0 = 9.9253e-04
Validation auc = 0.640772
Epoch 184
Validation auc = 0.658375
Epoch 185
Validation auc = 0.662803
Epoch 186
Validation auc = 0.660453
Epoch 187
Validation auc = 0.660125
Epoch 188
Loss = 1.5420e-01, PNorm = 81.3540, GNorm = 1.1412, lr_0 = 9.9228e-04
Loss = 2.0571e-02, PNorm = 81.3668, GNorm = 0.7113, lr_0 = 9.9226e-04
Validation auc = 0.661983
Epoch 189
Validation auc = 0.667068
Epoch 190
Validation auc = 0.670020
Epoch 191
Validation auc = 0.666357
Epoch 192
Validation auc = 0.665209
Epoch 193
Loss = 9.7301e-02, PNorm = 81.4886, GNorm = 1.8513, lr_0 = 9.9204e-04
Validation auc = 0.664334
Epoch 194
Validation auc = 0.667122
Epoch 195
Validation auc = 0.670621
Epoch 196
Validation auc = 0.673628
Epoch 197
Validation auc = 0.673300
Epoch 198
Loss = 3.5013e-02, PNorm = 81.6434, GNorm = 0.2696, lr_0 = 9.9177e-04
Validation auc = 0.674175
Epoch 199
Validation auc = 0.672316
Epoch 200
Validation auc = 0.671332
Epoch 201
Validation auc = 0.676853
Epoch 202
Loss = 9.3711e-02, PNorm = 81.7787, GNorm = 2.2543, lr_0 = 9.9154e-04
Loss = 3.3033e-02, PNorm = 81.7886, GNorm = 0.4993, lr_0 = 9.9153e-04
Validation auc = 0.681719
Epoch 203
Validation auc = 0.685382
Epoch 204
Validation auc = 0.696971
Epoch 205
Validation auc = 0.721026
Epoch 206
Validation auc = 0.679805
Epoch 207
Loss = 2.9025e-01, PNorm = 82.0289, GNorm = 4.7155, lr_0 = 9.9128e-04
Loss = 2.8335e-01, PNorm = 82.0554, GNorm = 2.0350, lr_0 = 9.9126e-04
Validation auc = 0.666248
Epoch 208
Validation auc = 0.660179
Epoch 209
Validation auc = 0.659797
Epoch 210
Validation auc = 0.658321
Epoch 211
Validation auc = 0.662366
Epoch 212
Loss = 1.1650e-01, PNorm = 82.3694, GNorm = 0.8066, lr_0 = 9.9103e-04
Validation auc = 0.673464
Epoch 213
Validation auc = 0.695878
Epoch 214
Validation auc = 0.710912
Epoch 215
Validation auc = 0.725836
Epoch 216
Loss = 4.9831e-01, PNorm = 82.6118, GNorm = 15.0857, lr_0 = 9.9079e-04
Validation auc = 0.723103
Epoch 217
Validation auc = 0.708342
Epoch 218
Validation auc = 0.692707
Epoch 219
Validation auc = 0.681937
Epoch 220
Validation auc = 0.666193
Epoch 221
Loss = 1.7595e-01, PNorm = 82.9193, GNorm = 0.7406, lr_0 = 9.9054e-04
Loss = 2.9907e-02, PNorm = 82.9377, GNorm = 0.3713, lr_0 = 9.9052e-04
Validation auc = 0.661437
Epoch 222
Validation auc = 0.650448
Epoch 223
Validation auc = 0.647223
Epoch 224
Validation auc = 0.652252
Epoch 225
Validation auc = 0.657883
Epoch 226
Loss = 1.1993e-01, PNorm = 83.1579, GNorm = 1.3798, lr_0 = 9.9030e-04
Validation auc = 0.650667
Epoch 227
Validation auc = 0.644489
Epoch 228
Validation auc = 0.664170
Epoch 229
Validation auc = 0.685710
Epoch 230
Validation auc = 0.702657
Epoch 231
Loss = 1.0860e-01, PNorm = 83.3327, GNorm = 1.3357, lr_0 = 9.9003e-04
Validation auc = 0.715941
Epoch 232
Validation auc = 0.715723
Epoch 233
Validation auc = 0.700251
Epoch 234
Validation auc = 0.695222
Epoch 235
Loss = 1.1771e-01, PNorm = 83.4589, GNorm = 1.6292, lr_0 = 9.8980e-04
Loss = 3.0693e-03, PNorm = 83.4672, GNorm = 0.0691, lr_0 = 9.8979e-04
Validation auc = 0.686803
Epoch 236
Validation auc = 0.683796
Epoch 237
Validation auc = 0.677017
Epoch 238
Validation auc = 0.670293
Epoch 239
Validation auc = 0.674120
Epoch 240
Loss = 1.1006e-01, PNorm = 83.5848, GNorm = 0.3491, lr_0 = 9.8954e-04
Loss = 2.0934e-02, PNorm = 83.6009, GNorm = 0.7680, lr_0 = 9.8952e-04
Validation auc = 0.697627
Epoch 241
Validation auc = 0.705445
Epoch 242
Validation auc = 0.696097
Epoch 243
Validation auc = 0.664279
Epoch 244
Validation auc = 0.651159
Epoch 245
Loss = 1.8932e-01, PNorm = 83.8130, GNorm = 1.6537, lr_0 = 9.8930e-04
Validation auc = 0.652416
Epoch 246
Validation auc = 0.650722
Epoch 247
Validation auc = 0.644653
Epoch 248
Validation auc = 0.641701
Epoch 249
Loss = 1.1307e-01, PNorm = 84.0059, GNorm = 0.4359, lr_0 = 9.8905e-04
Validation auc = 0.639679
Epoch 250
Validation auc = 0.641319
Epoch 251
Validation auc = 0.642521
Epoch 252
Validation auc = 0.645473
Epoch 253
Validation auc = 0.649628
Epoch 254
Loss = 1.1312e-02, PNorm = 84.1537, GNorm = 0.1405, lr_0 = 9.8880e-04
Loss = 5.2638e-03, PNorm = 84.1624, GNorm = 0.1975, lr_0 = 9.8879e-04
Validation auc = 0.652307
Epoch 255
Validation auc = 0.654494
Epoch 256
Validation auc = 0.653728
Epoch 257
Validation auc = 0.648426
Epoch 258
Validation auc = 0.642849
Epoch 259
Loss = 7.1185e-03, PNorm = 84.2321, GNorm = 0.2183, lr_0 = 9.8856e-04
Validation auc = 0.640881
Epoch 260
Validation auc = 0.644161
Epoch 261
Validation auc = 0.651159
Epoch 262
Validation auc = 0.655150
Epoch 263
Validation auc = 0.655259
Epoch 264
Loss = 2.1661e-02, PNorm = 84.2777, GNorm = 0.7275, lr_0 = 9.8830e-04
Validation auc = 0.657719
Epoch 265
Validation auc = 0.663186
Epoch 266
Validation auc = 0.662967
Epoch 267
Validation auc = 0.659851
Epoch 268
Loss = 5.4657e-02, PNorm = 84.3236, GNorm = 1.7714, lr_0 = 9.8807e-04
Loss = 5.9698e-01, PNorm = 84.3231, GNorm = 12.0999, lr_0 = 9.8805e-04
Validation auc = 0.667341
Epoch 269
Validation auc = 0.691942
Epoch 270
Validation auc = 0.702165
Epoch 271
Validation auc = 0.689318
Epoch 272
Validation auc = 0.677400
Epoch 273
Loss = 1.3654e-01, PNorm = 84.4857, GNorm = 2.2505, lr_0 = 9.8781e-04
Loss = 1.3789e-02, PNorm = 84.4993, GNorm = 0.2536, lr_0 = 9.8779e-04
Validation auc = 0.681664
Epoch 274
Validation auc = 0.681172
Epoch 275
Validation auc = 0.679860
Epoch 276
Validation auc = 0.674065
Epoch 277
Validation auc = 0.670730
Epoch 278
Loss = 1.9085e-02, PNorm = 84.6583, GNorm = 0.3668, lr_0 = 9.8756e-04
Validation auc = 0.661109
Epoch 279
Validation auc = 0.668380
Epoch 280
Validation auc = 0.685108
Epoch 281
Validation auc = 0.694730
Epoch 282
Validation auc = 0.699814
Epoch 283
Loss = 6.1572e-02, PNorm = 84.8306, GNorm = 0.3617, lr_0 = 9.8730e-04
Validation auc = 0.707358
Epoch 284
Validation auc = 0.715176
Epoch 285
Validation auc = 0.700579
Epoch 286
Validation auc = 0.684562
Epoch 287
Loss = 7.5786e-02, PNorm = 84.9762, GNorm = 1.1584, lr_0 = 9.8707e-04
Loss = 5.7869e-03, PNorm = 84.9869, GNorm = 0.1785, lr_0 = 9.8705e-04
Validation auc = 0.680024
Epoch 288
Validation auc = 0.676580
Epoch 289
Validation auc = 0.666138
Epoch 290
Validation auc = 0.659961
Epoch 291
Validation auc = 0.657719
Epoch 292
Loss = 7.1580e-03, PNorm = 85.1345, GNorm = 0.0943, lr_0 = 9.8683e-04
Validation auc = 0.657555
Epoch 293
Validation auc = 0.650831
Epoch 294
Validation auc = 0.651760
Epoch 295
Validation auc = 0.670512
Epoch 296
Validation auc = 0.674940
Epoch 297
Loss = 4.7868e-02, PNorm = 85.2708, GNorm = 2.0386, lr_0 = 9.8656e-04
Validation auc = 0.659469
Epoch 298
Validation auc = 0.703532
Epoch 299
Validation auc = 0.695058
Epoch 300
Validation auc = 0.692325
Epoch 301
Loss = 2.1397e-01, PNorm = 85.5083, GNorm = 2.3706, lr_0 = 9.8634e-04
Loss = 2.0794e-01, PNorm = 85.5317, GNorm = 4.9459, lr_0 = 9.8632e-04
Validation auc = 0.709162
Epoch 302
Validation auc = 0.728679
Epoch 303
Validation auc = 0.740488
Epoch 304
Validation auc = 0.728789
Epoch 305
Validation auc = 0.697299
Epoch 306
Loss = 1.5024e-01, PNorm = 85.8175, GNorm = 1.1829, lr_0 = 9.8607e-04
Loss = 3.4137e-02, PNorm = 85.8356, GNorm = 0.6510, lr_0 = 9.8606e-04
Validation auc = 0.681773
Epoch 307
Validation auc = 0.678493
Epoch 308
Validation auc = 0.673901
Epoch 309
Validation auc = 0.674065
Epoch 310
Validation auc = 0.676689
Epoch 311
Loss = 2.5058e-02, PNorm = 86.0060, GNorm = 0.2829, lr_0 = 9.8583e-04
Validation auc = 0.678603
Epoch 312
Validation auc = 0.676963
Epoch 313
Validation auc = 0.676361
Epoch 314
Validation auc = 0.674557
Epoch 315
Validation auc = 0.669746
Epoch 316
Loss = 9.6531e-02, PNorm = 86.1935, GNorm = 0.4559, lr_0 = 9.8557e-04
Validation auc = 0.669418
Epoch 317
Validation auc = 0.670238
Epoch 318
Validation auc = 0.671988
Epoch 319
Validation auc = 0.677345
Epoch 320
Loss = 4.4714e-02, PNorm = 86.3456, GNorm = 0.1340, lr_0 = 9.8534e-04
Loss = 6.0274e-03, PNorm = 86.3574, GNorm = 0.0898, lr_0 = 9.8532e-04
Validation auc = 0.681227
Epoch 321
Validation auc = 0.682101
Epoch 322
Validation auc = 0.677673
Epoch 323
Validation auc = 0.676635
Epoch 324
Validation auc = 0.672808
Epoch 325
Loss = 7.9821e-02, PNorm = 86.4774, GNorm = 3.6199, lr_0 = 9.8509e-04
Validation auc = 0.684835
Epoch 326
Validation auc = 0.695222
Epoch 327
Validation auc = 0.705062
Epoch 328
Validation auc = 0.713372
Epoch 329
Validation auc = 0.716652
Epoch 330
Loss = 1.4836e-01, PNorm = 86.6525, GNorm = 2.4897, lr_0 = 9.8483e-04
Validation auc = 0.726547
Epoch 331
Validation auc = 0.749617
Epoch 332
Validation auc = 0.744150
Epoch 333
Validation auc = 0.727094
Epoch 334
Loss = 9.9375e-02, PNorm = 86.8152, GNorm = 1.6626, lr_0 = 9.8461e-04
Loss = 2.8127e-02, PNorm = 86.8288, GNorm = 0.7335, lr_0 = 9.8459e-04
Validation auc = 0.725344
Epoch 335
Validation auc = 0.724743
Epoch 336
Validation auc = 0.720916
Epoch 337
Validation auc = 0.717363
Epoch 338
Validation auc = 0.715504
Epoch 339
Loss = 7.9182e-02, PNorm = 86.9850, GNorm = 1.3535, lr_0 = 9.8434e-04
Loss = 2.5892e-03, PNorm = 86.9955, GNorm = 0.0566, lr_0 = 9.8433e-04
Validation auc = 0.716816
Epoch 340
Validation auc = 0.718019
Epoch 341
Validation auc = 0.718292
Epoch 342
Validation auc = 0.715395
Epoch 343
Validation auc = 0.710693
Epoch 344
Loss = 7.4895e-03, PNorm = 87.1401, GNorm = 0.0825, lr_0 = 9.8410e-04
Validation auc = 0.694183
Epoch 345
Validation auc = 0.687678
Epoch 346
Validation auc = 0.710639
Epoch 347
Validation auc = 0.725399
Epoch 348
Validation auc = 0.727914
Epoch 349
Loss = 6.6436e-02, PNorm = 87.3624, GNorm = 0.6021, lr_0 = 9.8384e-04
Validation auc = 0.734529
Epoch 350
Validation auc = 0.746064
Epoch 351
Validation auc = 0.758966
Epoch 352
Validation auc = 0.764815
Epoch 353
Loss = 5.6510e-02, PNorm = 87.5753, GNorm = 0.3051, lr_0 = 9.8361e-04
Loss = 8.1433e-02, PNorm = 87.5909, GNorm = 2.5791, lr_0 = 9.8359e-04
Validation auc = 0.764761
Epoch 354
Validation auc = 0.763941
Epoch 355
Validation auc = 0.762738
Epoch 356
Validation auc = 0.764979
Epoch 357
Validation auc = 0.764487
Epoch 358
Loss = 3.6495e-02, PNorm = 87.7859, GNorm = 1.1230, lr_0 = 9.8335e-04
Validation auc = 0.766127
Epoch 359
Validation auc = 0.736278
Epoch 360
Validation auc = 0.722174
Epoch 361
Validation auc = 0.715340
Epoch 362
Validation auc = 0.710365
Epoch 363
Loss = 5.3712e-02, PNorm = 87.9288, GNorm = 0.7645, lr_0 = 9.8311e-04
Validation auc = 0.704680
Epoch 364
Validation auc = 0.696479
Epoch 365
Validation auc = 0.699322
Epoch 366
Validation auc = 0.705445
Epoch 367
Loss = 1.7068e-02, PNorm = 88.0678, GNorm = 0.9861, lr_0 = 9.8288e-04
Loss = 3.4152e-03, PNorm = 88.0760, GNorm = 0.0580, lr_0 = 9.8286e-04
Validation auc = 0.708506
Epoch 368
Validation auc = 0.710147
Epoch 369
Validation auc = 0.707413
Epoch 370
Validation auc = 0.707577
Epoch 371
Validation auc = 0.708069
Epoch 372
Loss = 6.0958e-03, PNorm = 88.1554, GNorm = 0.0571, lr_0 = 9.8262e-04
Loss = 7.4081e-03, PNorm = 88.1597, GNorm = 0.3376, lr_0 = 9.8260e-04
Validation auc = 0.709873
Epoch 373
Validation auc = 0.709381
Epoch 374
Validation auc = 0.711021
Epoch 375
Validation auc = 0.711677
Epoch 376
Validation auc = 0.712935
Epoch 377
Loss = 1.0893e-02, PNorm = 88.2037, GNorm = 0.3848, lr_0 = 9.8237e-04
Validation auc = 0.714793
Epoch 378
Validation auc = 0.716761
Epoch 379
Validation auc = 0.715559
Epoch 380
Validation auc = 0.714957
Epoch 381
Validation auc = 0.715285
Epoch 382
Loss = 2.7333e-03, PNorm = 88.2424, GNorm = 0.0635, lr_0 = 9.8211e-04
Validation auc = 0.715176
Epoch 383
Validation auc = 0.714028
Epoch 384
Validation auc = 0.713919
Epoch 385
Validation auc = 0.708124
Epoch 386
Loss = 1.7081e-02, PNorm = 88.2724, GNorm = 1.2790, lr_0 = 9.8189e-04
Loss = 1.4547e-02, PNorm = 88.2746, GNorm = 0.6491, lr_0 = 9.8187e-04
Validation auc = 0.706538
Epoch 387
Validation auc = 0.709217
Epoch 388
Validation auc = 0.714356
Epoch 389
Validation auc = 0.714192
Epoch 390
Validation auc = 0.714684
Epoch 391
Loss = 1.6378e-03, PNorm = 88.3111, GNorm = 0.2715, lr_0 = 9.8163e-04
Validation auc = 0.715340
Epoch 392
Validation auc = 0.715723
Epoch 393
Validation auc = 0.718456
Epoch 394
Validation auc = 0.719659
Epoch 395
Validation auc = 0.717199
Epoch 396
Loss = 3.9197e-03, PNorm = 88.3436, GNorm = 0.1047, lr_0 = 9.8138e-04
Validation auc = 0.714575
Epoch 397
Validation auc = 0.713263
Epoch 398
Validation auc = 0.712607
Epoch 399
Validation auc = 0.708944
Epoch 400
Loss = 1.5575e-03, PNorm = 88.3505, GNorm = 0.0435, lr_0 = 9.8116e-04
Loss = 1.9887e-03, PNorm = 88.3500, GNorm = 0.0590, lr_0 = 9.8114e-04
Validation auc = 0.705773
Epoch 401
Validation auc = 0.701782
Epoch 402
Validation auc = 0.690903
Epoch 403
Validation auc = 0.695277
Epoch 404
Validation auc = 0.700087
Epoch 405
Loss = 7.0964e-03, PNorm = 88.3635, GNorm = 0.0871, lr_0 = 9.8089e-04
Loss = 3.4723e-02, PNorm = 88.3650, GNorm = 2.1366, lr_0 = 9.8088e-04
Validation auc = 0.706156
Epoch 406
Validation auc = 0.716379
Epoch 407
Validation auc = 0.722338
Epoch 408
Validation auc = 0.719495
Epoch 409
Validation auc = 0.709928
Epoch 410
Loss = 7.3371e-03, PNorm = 88.4168, GNorm = 0.2382, lr_0 = 9.8065e-04
Validation auc = 0.706265
Epoch 411
Validation auc = 0.714957
Epoch 412
Validation auc = 0.722392
Epoch 413
Validation auc = 0.727640
Epoch 414
Validation auc = 0.726383
Epoch 415
Loss = 2.6550e-03, PNorm = 88.4668, GNorm = 0.0653, lr_0 = 9.8039e-04
Validation auc = 0.726274
Epoch 416
Validation auc = 0.726164
Epoch 417
Validation auc = 0.726602
Epoch 418
Validation auc = 0.723103
Epoch 419
Loss = 1.9371e-02, PNorm = 88.5180, GNorm = 0.0546, lr_0 = 9.8016e-04
Loss = 2.4466e-03, PNorm = 88.5215, GNorm = 0.1067, lr_0 = 9.8015e-04
Validation auc = 0.718784
Epoch 420
Validation auc = 0.715121
Epoch 421
Validation auc = 0.721518
Epoch 422
Validation auc = 0.735294
Epoch 423
Validation auc = 0.731194
Epoch 424
Loss = 6.0268e-02, PNorm = 88.5693, GNorm = 0.5646, lr_0 = 9.7990e-04
Validation auc = 0.729390
Epoch 425
Validation auc = 0.723540
Epoch 426
Validation auc = 0.721518
Epoch 427
Validation auc = 0.720151
Epoch 428
Validation auc = 0.712880
Epoch 429
Loss = 1.7498e-02, PNorm = 88.6969, GNorm = 0.2849, lr_0 = 9.7966e-04
Validation auc = 0.712115
Epoch 430
Validation auc = 0.721846
Epoch 431
Validation auc = 0.727531
Epoch 432
Validation auc = 0.729117
Epoch 433
Loss = 5.7132e-02, PNorm = 88.8258, GNorm = 0.0865, lr_0 = 9.7942e-04
Validation auc = 0.742401
Epoch 434
Validation auc = 0.750547
Epoch 435
Validation auc = 0.756615
Epoch 436
Validation auc = 0.760824
Epoch 437
Validation auc = 0.763066
Epoch 438
Loss = 3.1805e-02, PNorm = 88.9539, GNorm = 0.6548, lr_0 = 9.7917e-04
Loss = 8.9880e-04, PNorm = 88.9610, GNorm = 0.0231, lr_0 = 9.7916e-04
Validation auc = 0.760660
Epoch 439
Validation auc = 0.759840
Epoch 440
Validation auc = 0.757818
Epoch 441
Validation auc = 0.754592
Epoch 442
Validation auc = 0.751749
Epoch 443
Loss = 5.0241e-02, PNorm = 89.0220, GNorm = 2.2510, lr_0 = 9.7893e-04
Validation auc = 0.754920
Epoch 444
Validation auc = 0.756506
Epoch 445
Validation auc = 0.756998
Epoch 446
Validation auc = 0.725071
Epoch 447
Validation auc = 0.689810
Epoch 448
Loss = 2.0935e-01, PNorm = 89.1246, GNorm = 3.2163, lr_0 = 9.7867e-04
Validation auc = 0.709600
Epoch 449
Validation auc = 0.662257
Epoch 450
Validation auc = 0.638421
Epoch 451
Validation auc = 0.653346
Epoch 452
Loss = 1.3018e-01, PNorm = 89.5171, GNorm = 0.6930, lr_0 = 9.7845e-04
Loss = 1.1849e-01, PNorm = 89.5476, GNorm = 0.8846, lr_0 = 9.7843e-04
Validation auc = 0.672480
Epoch 453
Validation auc = 0.689044
Epoch 454
Validation auc = 0.700033
Epoch 455
Validation auc = 0.701236
Epoch 456
Validation auc = 0.699158
Epoch 457
Loss = 1.4866e-02, PNorm = 89.9230, GNorm = 0.4450, lr_0 = 9.7819e-04
Loss = 7.3788e-04, PNorm = 89.9435, GNorm = 0.0163, lr_0 = 9.7817e-04
Validation auc = 0.695659
Epoch 458
Validation auc = 0.697245
Epoch 459
Validation auc = 0.702220
Epoch 460
Validation auc = 0.706702
Epoch 461
Validation auc = 0.709272
Epoch 462
Loss = 7.1662e-04, PNorm = 90.1212, GNorm = 0.0335, lr_0 = 9.7794e-04
Validation auc = 0.709326
Epoch 463
Validation auc = 0.709873
Epoch 464
Validation auc = 0.708452
Epoch 465
Validation auc = 0.702657
Epoch 466
Loss = 1.0575e+00, PNorm = 90.2396, GNorm = 19.0747, lr_0 = 9.7770e-04
Validation auc = 0.694675
Epoch 467
Validation auc = 0.633884
Epoch 468
Validation auc = 0.585721
Epoch 469
Validation auc = 0.568008
Epoch 470
Validation auc = 0.571725
Epoch 471
Loss = 1.4352e-01, PNorm = 90.5628, GNorm = 1.1237, lr_0 = 9.7746e-04
Loss = 1.5077e-01, PNorm = 90.5888, GNorm = 2.2379, lr_0 = 9.7744e-04
Validation auc = 0.583807
Epoch 472
Validation auc = 0.599770
Epoch 473
Validation auc = 0.623497
Epoch 474
Validation auc = 0.648644
Epoch 475
Validation auc = 0.667013
Epoch 476
Loss = 6.9095e-02, PNorm = 90.8997, GNorm = 1.1662, lr_0 = 9.7721e-04
Validation auc = 0.663733
Epoch 477
Validation auc = 0.652416
Epoch 478
Validation auc = 0.645747
Epoch 479
Validation auc = 0.641155
Epoch 480
Validation auc = 0.643013
Epoch 481
Loss = 1.2952e-02, PNorm = 91.1315, GNorm = 0.8908, lr_0 = 9.7695e-04
Validation auc = 0.642631
Epoch 482
Validation auc = 0.644271
Epoch 483
Validation auc = 0.651596
Epoch 484
Validation auc = 0.661765
Epoch 485
Loss = 2.8223e-02, PNorm = 91.2528, GNorm = 0.9561, lr_0 = 9.7673e-04
Loss = 7.7548e-03, PNorm = 91.2625, GNorm = 0.5199, lr_0 = 9.7671e-04
Validation auc = 0.664826
Epoch 486
Validation auc = 0.663842
Epoch 487
Validation auc = 0.662475
Epoch 488
Validation auc = 0.656188
Epoch 489
Validation auc = 0.648262
Epoch 490
Loss = 6.5612e-02, PNorm = 91.4106, GNorm = 6.7398, lr_0 = 9.7647e-04
Loss = 6.4011e-03, PNorm = 91.4194, GNorm = 0.2514, lr_0 = 9.7645e-04
Validation auc = 0.653455
Epoch 491
Validation auc = 0.675377
Epoch 492
Validation auc = 0.685491
Epoch 493
Validation auc = 0.691231
Epoch 494
Validation auc = 0.693855
Epoch 495
Loss = 5.6120e-03, PNorm = 91.5271, GNorm = 0.1302, lr_0 = 9.7623e-04
Validation auc = 0.697354
Epoch 496
Validation auc = 0.701236
Epoch 497
Validation auc = 0.703040
Epoch 498
Validation auc = 0.704133
Epoch 499
Loss = 3.2150e-03, PNorm = 91.6238, GNorm = 0.0065, lr_0 = 9.7599e-04
Validation auc = 0.706101
Epoch 500
Validation auc = 0.704516
Epoch 501
Validation auc = 0.700634
Epoch 502
Validation auc = 0.705172
Epoch 503
Validation auc = 0.712935
Epoch 504
Loss = 1.2738e-01, PNorm = 91.7200, GNorm = 1.4917, lr_0 = 9.7574e-04
Loss = 1.3422e-01, PNorm = 91.7316, GNorm = 7.3549, lr_0 = 9.7573e-04
Validation auc = 0.715941
Epoch 505
Validation auc = 0.714411
Epoch 506
Validation auc = 0.718237
Epoch 507
Validation auc = 0.722447
Epoch 508
Validation auc = 0.713591
Epoch 509
Loss = 7.0766e-02, PNorm = 91.9208, GNorm = 1.5690, lr_0 = 9.7550e-04
Validation auc = 0.715176
Epoch 510
Validation auc = 0.713372
Epoch 511
Validation auc = 0.716269
Epoch 512
Validation auc = 0.710311
Epoch 513
Validation auc = 0.702930
Epoch 514
Loss = 3.2569e-02, PNorm = 92.2715, GNorm = 0.4055, lr_0 = 9.7524e-04
Validation auc = 0.705828
Epoch 515
Validation auc = 0.715012
Epoch 516
Validation auc = 0.719495
Epoch 517
Validation auc = 0.719604
Epoch 518
Loss = 5.5420e-02, PNorm = 92.5399, GNorm = 1.2096, lr_0 = 9.7502e-04
Loss = 7.0896e-02, PNorm = 92.5565, GNorm = 2.3713, lr_0 = 9.7500e-04
Validation auc = 0.714137
Epoch 519
Validation auc = 0.706374
Epoch 520
Validation auc = 0.700197
Epoch 521
Validation auc = 0.695495
Epoch 522
Validation auc = 0.690958
Epoch 523
Loss = 6.8140e-02, PNorm = 92.7242, GNorm = 0.6086, lr_0 = 9.7476e-04
Loss = 2.5271e-04, PNorm = 92.7306, GNorm = 0.0080, lr_0 = 9.7474e-04
Validation auc = 0.687678
Epoch 524
Validation auc = 0.687186
Epoch 525
Validation auc = 0.686967
Epoch 526
Validation auc = 0.689755
Epoch 527
Validation auc = 0.694347
Epoch 528
Loss = 6.1931e-03, PNorm = 92.7925, GNorm = 0.1103, lr_0 = 9.7452e-04
Validation auc = 0.701017
Epoch 529
Validation auc = 0.705281
Epoch 530
Validation auc = 0.707905
Epoch 531
Validation auc = 0.709654
Epoch 532
Validation auc = 0.711951
Epoch 533
Loss = 1.1539e-02, PNorm = 92.8721, GNorm = 0.4896, lr_0 = 9.7426e-04
Validation auc = 0.712935
Epoch 534
Validation auc = 0.711459
Epoch 535
Validation auc = 0.714301
Epoch 536
Validation auc = 0.715559
Epoch 537
Loss = 1.9554e-02, PNorm = 92.9293, GNorm = 0.1958, lr_0 = 9.7403e-04
Loss = 4.8043e-03, PNorm = 92.9372, GNorm = 0.1081, lr_0 = 9.7401e-04
Validation auc = 0.711349
Epoch 538
Validation auc = 0.714465
Epoch 539
Validation auc = 0.714739
Epoch 540
Validation auc = 0.707577
Epoch 541
Validation auc = 0.700415
Epoch 542
Loss = 7.7806e-02, PNorm = 92.9902, GNorm = 0.6456, lr_0 = 9.7379e-04
Validation auc = 0.696917
Epoch 543
Validation auc = 0.698338
Epoch 544
Validation auc = 0.697081
Epoch 545
Validation auc = 0.697955
Epoch 546
Validation auc = 0.697463
Epoch 547
Loss = 2.9733e-02, PNorm = 93.1362, GNorm = 1.1803, lr_0 = 9.7353e-04
Validation auc = 0.705828
Epoch 548
Validation auc = 0.711568
Epoch 549
Validation auc = 0.712005
Epoch 550
Validation auc = 0.703914
Epoch 551
Loss = 3.3705e-02, PNorm = 93.2376, GNorm = 0.2164, lr_0 = 9.7331e-04
Loss = 6.7883e-04, PNorm = 93.2444, GNorm = 0.0173, lr_0 = 9.7329e-04
Validation auc = 0.699759
Epoch 552
Validation auc = 0.700197
Epoch 553
Validation auc = 0.695987
Epoch 554
Validation auc = 0.714137
Epoch 555
Validation auc = 0.719222
Epoch 556
Loss = 2.9231e-02, PNorm = 93.3697, GNorm = 0.1059, lr_0 = 9.7305e-04
Loss = 7.9717e-04, PNorm = 93.3798, GNorm = 0.0199, lr_0 = 9.7303e-04
Validation auc = 0.720971
Epoch 557
Validation auc = 0.722939
Epoch 558
Validation auc = 0.723923
Epoch 559
Validation auc = 0.722666
Epoch 560
Validation auc = 0.723868
Epoch 561
Loss = 2.0351e-02, PNorm = 93.4713, GNorm = 0.5476, lr_0 = 9.7281e-04
Validation auc = 0.725508
Epoch 562
Validation auc = 0.727312
Epoch 563
Validation auc = 0.727586
Epoch 564
Validation auc = 0.722502
Epoch 565
Validation auc = 0.721299
Epoch 566
Loss = 1.6730e-02, PNorm = 93.6029, GNorm = 0.2328, lr_0 = 9.7255e-04
Validation auc = 0.722666
Epoch 567
Validation auc = 0.726438
Epoch 568
Validation auc = 0.733107
Epoch 569
Validation auc = 0.737536
Epoch 570
Loss = 5.7022e-02, PNorm = 93.7179, GNorm = 0.4275, lr_0 = 9.7232e-04
Loss = 3.0398e-03, PNorm = 93.7250, GNorm = 0.1001, lr_0 = 9.7231e-04
Validation auc = 0.738192
Epoch 571
Validation auc = 0.739613
Epoch 572
Validation auc = 0.739886
Epoch 573
Validation auc = 0.739886
Epoch 574
Validation auc = 0.738684
Epoch 575
Loss = 3.5805e-03, PNorm = 93.8106, GNorm = 0.0685, lr_0 = 9.7208e-04
Validation auc = 0.737426
Epoch 576
Validation auc = 0.736223
Epoch 577
Validation auc = 0.735567
Epoch 578
Validation auc = 0.734419
Epoch 579
Validation auc = 0.734474
Epoch 580
Loss = 3.4327e-04, PNorm = 93.8888, GNorm = 0.0088, lr_0 = 9.7182e-04
Validation auc = 0.734638
Epoch 581
Validation auc = 0.735349
Epoch 582
Validation auc = 0.734255
Epoch 583
Validation auc = 0.733490
Epoch 584
Loss = 1.0063e-03, PNorm = 93.9146, GNorm = 0.0310, lr_0 = 9.7160e-04
Loss = 4.0121e-04, PNorm = 93.9160, GNorm = 0.0305, lr_0 = 9.7158e-04
Validation auc = 0.732233
Epoch 585
Validation auc = 0.732998
Epoch 586
Validation auc = 0.732561
Epoch 587
Validation auc = 0.735786
Epoch 588
Validation auc = 0.738028
Epoch 589
Loss = 9.2514e-04, PNorm = 93.9478, GNorm = 0.0366, lr_0 = 9.7134e-04
Loss = 5.6162e-05, PNorm = 93.9503, GNorm = 0.0023, lr_0 = 9.7132e-04
Validation auc = 0.738848
Epoch 590
Validation auc = 0.741636
Epoch 591
Validation auc = 0.743822
Epoch 592
Validation auc = 0.745189
Epoch 593
Validation auc = 0.745627
Epoch 594
Loss = 8.3312e-04, PNorm = 93.9852, GNorm = 0.0450, lr_0 = 9.7110e-04
Validation auc = 0.745408
Epoch 595
Validation auc = 0.743768
Epoch 596
Validation auc = 0.742620
Epoch 597
Validation auc = 0.742018
Epoch 598
Validation auc = 0.742073
Epoch 599
Loss = 1.0092e-04, PNorm = 94.0308, GNorm = 0.0026, lr_0 = 9.7084e-04
Validation auc = 0.742401
Epoch 600
Validation auc = 0.743002
Epoch 601
Validation auc = 0.743549
Epoch 602
Validation auc = 0.744752
Epoch 603
Loss = 1.7219e-03, PNorm = 94.0639, GNorm = 0.2766, lr_0 = 9.7062e-04
Loss = 1.2011e-03, PNorm = 94.0669, GNorm = 0.1258, lr_0 = 9.7060e-04
Validation auc = 0.745408
Epoch 604
Validation auc = 0.745681
Epoch 605
Validation auc = 0.742128
Epoch 606
Validation auc = 0.730101
Epoch 607
Validation auc = 0.722228
Epoch 608
Loss = 1.8876e-01, PNorm = 94.1207, GNorm = 0.4912, lr_0 = 9.7036e-04
Validation auc = 0.715941
Epoch 609
Validation auc = 0.721354
Epoch 610
Validation auc = 0.729117
Epoch 611
Validation auc = 0.726328
Epoch 612
Validation auc = 0.723212
Epoch 613
Loss = 5.1914e-02, PNorm = 94.2561, GNorm = 0.9870, lr_0 = 9.7012e-04
Validation auc = 0.721463
Epoch 614
Validation auc = 0.723212
Epoch 615
Validation auc = 0.726820
Epoch 616
Validation auc = 0.729226
Epoch 617
Loss = 2.2700e-02, PNorm = 94.3652, GNorm = 0.7751, lr_0 = 9.6990e-04
Loss = 1.0450e-02, PNorm = 94.3724, GNorm = 0.1997, lr_0 = 9.6988e-04
Validation auc = 0.730374
Epoch 618
Validation auc = 0.731850
Epoch 619
Validation auc = 0.733818
Epoch 620
Validation auc = 0.734474
Epoch 621
Validation auc = 0.735567
Epoch 622
Loss = 1.2553e-02, PNorm = 94.4450, GNorm = 0.7839, lr_0 = 9.6964e-04
Loss = 1.6934e-03, PNorm = 94.4489, GNorm = 0.0370, lr_0 = 9.6962e-04
Validation auc = 0.735239
Epoch 623
Validation auc = 0.734747
Epoch 624
Validation auc = 0.735075
Epoch 625
Validation auc = 0.734419
Epoch 626
Validation auc = 0.733381
Epoch 627
Loss = 7.0717e-03, PNorm = 94.4884, GNorm = 0.1957, lr_0 = 9.6940e-04
Validation auc = 0.732014
Epoch 628
Validation auc = 0.731139
Epoch 629
Validation auc = 0.730210
Epoch 630
Validation auc = 0.728898
Epoch 631
Validation auc = 0.725946
Epoch 632
Loss = 2.8499e-03, PNorm = 94.5176, GNorm = 0.0421, lr_0 = 9.6914e-04
Validation auc = 0.717691
Epoch 633
Validation auc = 0.708780
Epoch 634
Validation auc = 0.689700
Epoch 635
Validation auc = 0.669692
Epoch 636
Loss = 2.2714e-02, PNorm = 94.5726, GNorm = 0.0616, lr_0 = 9.6892e-04
Loss = 5.0673e-03, PNorm = 94.5763, GNorm = 0.1636, lr_0 = 9.6890e-04
Validation auc = 0.662421
Epoch 637
Validation auc = 0.661109
Epoch 638
Validation auc = 0.662530
Epoch 639
Validation auc = 0.665373
Epoch 640
Validation auc = 0.668325
Epoch 641
Loss = 8.3645e-02, PNorm = 94.6150, GNorm = 0.8927, lr_0 = 9.6866e-04
Validation auc = 0.670457
Epoch 642
Validation auc = 0.673956
Epoch 643
Validation auc = 0.677673
Epoch 644
Validation auc = 0.681336
Epoch 645
Validation auc = 0.683468
Epoch 646
Loss = 4.0879e-03, PNorm = 94.6535, GNorm = 0.0737, lr_0 = 9.6842e-04
Validation auc = 0.686311
Epoch 647
Validation auc = 0.688006
Epoch 648
Validation auc = 0.689591
Epoch 649
Validation auc = 0.689974
Epoch 650
Loss = 8.0380e-04, PNorm = 94.6806, GNorm = 0.0168, lr_0 = 9.6820e-04
Loss = 2.5429e-04, PNorm = 94.6820, GNorm = 0.0092, lr_0 = 9.6818e-04
Validation auc = 0.690247
Epoch 651
Validation auc = 0.689044
Epoch 652
Validation auc = 0.687732
Epoch 653
Validation auc = 0.687022
Epoch 654
Validation auc = 0.687951
Epoch 655
Loss = 2.2498e-03, PNorm = 94.6901, GNorm = 0.0374, lr_0 = 9.6794e-04
Loss = 2.1281e-03, PNorm = 94.6911, GNorm = 0.0769, lr_0 = 9.6792e-04
Validation auc = 0.688552
Epoch 656
Validation auc = 0.689755
Epoch 657
Validation auc = 0.697627
Epoch 658
Validation auc = 0.703914
Epoch 659
Validation auc = 0.705937
Epoch 660
Loss = 1.0302e-02, PNorm = 94.7584, GNorm = 0.4452, lr_0 = 9.6770e-04
Validation auc = 0.709709
Epoch 661
Validation auc = 0.714083
Epoch 662
Validation auc = 0.715121
Epoch 663
Validation auc = 0.715613
Epoch 664
Validation auc = 0.717417
Epoch 665
Loss = 6.9690e-03, PNorm = 94.8371, GNorm = 0.3046, lr_0 = 9.6744e-04
Validation auc = 0.718565
Epoch 666
Validation auc = 0.718401
Epoch 667
Validation auc = 0.715285
Epoch 668
Validation auc = 0.708288
Epoch 669
Loss = 4.3876e-01, PNorm = 94.9743, GNorm = 5.1114, lr_0 = 9.6722e-04
Loss = 5.4607e-01, PNorm = 95.0014, GNorm = 8.6002, lr_0 = 9.6720e-04
Validation auc = 0.681336
Epoch 670
Validation auc = 0.617319
Epoch 671
Validation auc = 0.621802
Epoch 672
Validation auc = 0.622567
Epoch 673
Validation auc = 0.654658
Epoch 674
Loss = 1.1553e-01, PNorm = 95.5231, GNorm = 0.6469, lr_0 = 9.6696e-04
Validation auc = 0.674229
Epoch 675
Validation auc = 0.683195
Epoch 676
Validation auc = 0.689919
Epoch 677
Validation auc = 0.695933
Epoch 678
Validation auc = 0.696589
Epoch 679
Loss = 1.3782e-01, PNorm = 95.9221, GNorm = 1.8166, lr_0 = 9.6672e-04
Validation auc = 0.699486
Epoch 680
Validation auc = 0.702657
Epoch 681
Validation auc = 0.703805
Epoch 682
Validation auc = 0.701509
Epoch 683
Loss = 2.4227e-02, PNorm = 96.1208, GNorm = 0.0239, lr_0 = 9.6648e-04
Validation auc = 0.704570
Epoch 684
Validation auc = 0.697354
Epoch 685
Validation auc = 0.679805
Epoch 686
Validation auc = 0.715012
Epoch 687
Validation auc = 0.725618
Epoch 688
Loss = 1.2039e-01, PNorm = 96.3073, GNorm = 0.5163, lr_0 = 9.6624e-04
Loss = 6.9018e-03, PNorm = 96.3299, GNorm = 0.1869, lr_0 = 9.6622e-04
Validation auc = 0.729937
Epoch 689
Validation auc = 0.727367
Epoch 690
Validation auc = 0.729663
Epoch 691
Validation auc = 0.726602
Epoch 692
Validation auc = 0.716051
Epoch 693
Loss = 6.6240e-02, PNorm = 96.5983, GNorm = 0.3563, lr_0 = 9.6600e-04
Validation auc = 0.709381
Epoch 694
Validation auc = 0.705226
Epoch 695
Validation auc = 0.711841
Epoch 696
Validation auc = 0.719495
Epoch 697
Validation auc = 0.705226
Epoch 698
Loss = 6.3309e-02, PNorm = 96.8678, GNorm = 1.3645, lr_0 = 9.6574e-04
Validation auc = 0.711349
Epoch 699
Validation auc = 0.751039
Epoch 700
Validation auc = 0.744424
Epoch 701
Validation auc = 0.739285
Epoch 702
Loss = 1.1456e-01, PNorm = 97.2643, GNorm = 2.0318, lr_0 = 9.6552e-04
Loss = 7.1094e-02, PNorm = 97.2924, GNorm = 2.0486, lr_0 = 9.6550e-04
Validation auc = 0.750273
Epoch 703
Validation auc = 0.756670
Epoch 704
Validation auc = 0.754319
Epoch 705
Validation auc = 0.748961
Epoch 706
Validation auc = 0.739777
Epoch 707
Loss = 9.0523e-02, PNorm = 97.5746, GNorm = 0.7540, lr_0 = 9.6526e-04
Loss = 5.0185e-03, PNorm = 97.5880, GNorm = 0.0965, lr_0 = 9.6525e-04
Validation auc = 0.727586
Epoch 708
Validation auc = 0.720971
Epoch 709
Validation auc = 0.723595
Epoch 710
Validation auc = 0.726656
Epoch 711
Validation auc = 0.727367
Epoch 712
Loss = 1.0264e-02, PNorm = 97.7307, GNorm = 0.5335, lr_0 = 9.6502e-04
Validation auc = 0.729445
Epoch 713
Validation auc = 0.741144
Epoch 714
Validation auc = 0.750219
Epoch 715
Validation auc = 0.759676
Epoch 716
Loss = 3.0063e-02, PNorm = 97.8283, GNorm = 0.0020, lr_0 = 9.6479e-04
Validation auc = 0.764761
Epoch 717
Validation auc = 0.756615
Epoch 718
Validation auc = 0.747704
Epoch 719
Validation auc = 0.742018
Epoch 720
Validation auc = 0.739340
Epoch 721
Loss = 9.6039e-03, PNorm = 97.8812, GNorm = 0.5749, lr_0 = 9.6455e-04
Loss = 1.0489e-01, PNorm = 97.8895, GNorm = 6.8752, lr_0 = 9.6453e-04
Validation auc = 0.736934
Epoch 722
Validation auc = 0.731850
Epoch 723
Validation auc = 0.728843
Epoch 724
Validation auc = 0.723759
Epoch 725
Validation auc = 0.718347
Epoch 726
Loss = 8.8820e-03, PNorm = 98.0239, GNorm = 0.4746, lr_0 = 9.6431e-04
Validation auc = 0.714793
Epoch 727
Validation auc = 0.714848
Epoch 728
Validation auc = 0.717144
Epoch 729
Validation auc = 0.723322
Epoch 730
Validation auc = 0.725454
Epoch 731
Loss = 3.6535e-02, PNorm = 98.1346, GNorm = 2.0888, lr_0 = 9.6405e-04
Validation auc = 0.723376
Epoch 732
Validation auc = 0.717144
Epoch 733
Validation auc = 0.708889
Epoch 734
Validation auc = 0.712115
Epoch 735
Loss = 2.5980e-02, PNorm = 98.2721, GNorm = 1.7475, lr_0 = 9.6383e-04
Loss = 8.5762e-02, PNorm = 98.2845, GNorm = 6.8527, lr_0 = 9.6381e-04
Validation auc = 0.711841
Epoch 736
Validation auc = 0.704844
Epoch 737
Validation auc = 0.682375
Epoch 738
Validation auc = 0.657173
Epoch 739
Validation auc = 0.717909
Epoch 740
Loss = 7.9258e-02, PNorm = 98.4903, GNorm = 0.2700, lr_0 = 9.6357e-04
Loss = 3.0795e-03, PNorm = 98.5072, GNorm = 0.0807, lr_0 = 9.6355e-04
Validation auc = 0.735239
Epoch 741
Validation auc = 0.740160
Epoch 742
Validation auc = 0.743549
Epoch 743
Validation auc = 0.745572
Epoch 744
Validation auc = 0.741690
Epoch 745
Loss = 1.0461e-01, PNorm = 98.6923, GNorm = 0.6797, lr_0 = 9.6333e-04
Validation auc = 0.725672
Epoch 746
Validation auc = 0.715723
Epoch 747
Validation auc = 0.714629
Epoch 748
Validation auc = 0.716925
Epoch 749
Loss = 3.0617e-02, PNorm = 98.8300, GNorm = 0.3378, lr_0 = 9.6309e-04
Validation auc = 0.720752
Epoch 750
Validation auc = 0.722666
Epoch 751
Validation auc = 0.722994
Epoch 752
Validation auc = 0.721080
Epoch 753
Validation auc = 0.717417
Epoch 754
Loss = 5.2286e-02, PNorm = 98.9400, GNorm = 0.8589, lr_0 = 9.6285e-04
Loss = 4.0968e-03, PNorm = 98.9462, GNorm = 0.1278, lr_0 = 9.6284e-04
Validation auc = 0.711677
Epoch 755
Validation auc = 0.701181
Epoch 756
Validation auc = 0.699377
Epoch 757
Validation auc = 0.703805
Epoch 758
Validation auc = 0.708561
Epoch 759
Loss = 6.7403e-03, PNorm = 99.0128, GNorm = 0.1106, lr_0 = 9.6262e-04
Validation auc = 0.711841
Epoch 760
Validation auc = 0.713919
Epoch 761
Validation auc = 0.715941
Epoch 762
Validation auc = 0.715340
Epoch 763
Validation auc = 0.713864
Epoch 764
Loss = 2.2586e-03, PNorm = 99.0679, GNorm = 0.0461, lr_0 = 9.6236e-04
Validation auc = 0.711623
Epoch 765
Validation auc = 0.710748
Epoch 766
Validation auc = 0.710475
Epoch 767
Validation auc = 0.710256
Epoch 768
Loss = 4.6816e-03, PNorm = 99.1072, GNorm = 0.0223, lr_0 = 9.6214e-04
Loss = 1.8027e-03, PNorm = 99.1100, GNorm = 0.0556, lr_0 = 9.6212e-04
Validation auc = 0.709873
Epoch 769
Validation auc = 0.707358
Epoch 770
Validation auc = 0.706484
Epoch 771
Validation auc = 0.706921
Epoch 772
Validation auc = 0.714793
Epoch 773
Loss = 3.5641e-04, PNorm = 99.1418, GNorm = 0.0074, lr_0 = 9.6188e-04
Loss = 2.5125e-03, PNorm = 99.1446, GNorm = 0.1167, lr_0 = 9.6186e-04
Validation auc = 0.725399
Epoch 774
Validation auc = 0.734529
Epoch 775
Validation auc = 0.739558
Epoch 776
Validation auc = 0.744041
Epoch 777
Validation auc = 0.748087
Epoch 778
Loss = 5.2123e-03, PNorm = 99.1751, GNorm = 0.9945, lr_0 = 9.6164e-04
Validation auc = 0.749891
Epoch 779
Validation auc = 0.735731
Epoch 780
Validation auc = 0.720042
Epoch 781
Validation auc = 0.709764
Epoch 782
Validation auc = 0.705281
Epoch 783
Loss = 6.7407e-03, PNorm = 99.2216, GNorm = 0.3625, lr_0 = 9.6139e-04
Validation auc = 0.705773
Epoch 784
Validation auc = 0.709326
Epoch 785
Validation auc = 0.712388
Epoch 786
Validation auc = 0.713700
Epoch 787
Loss = 8.1651e-04, PNorm = 99.2748, GNorm = 0.0409, lr_0 = 9.6117e-04
Loss = 1.5989e-04, PNorm = 99.2778, GNorm = 0.0039, lr_0 = 9.6115e-04
Validation auc = 0.714793
Epoch 788
Validation auc = 0.714684
Epoch 789
Validation auc = 0.717636
Epoch 790
Validation auc = 0.720643
Epoch 791
Validation auc = 0.724634
Epoch 792
Loss = 5.6424e-02, PNorm = 99.3163, GNorm = 0.8781, lr_0 = 9.6093e-04
Validation auc = 0.727039
Epoch 793
Validation auc = 0.724087
Epoch 794
Validation auc = 0.722720
Epoch 795
Validation auc = 0.721900
Epoch 796
Validation auc = 0.725782
Epoch 797
Loss = 2.9642e-03, PNorm = 99.3586, GNorm = 0.0685, lr_0 = 9.6067e-04
Validation auc = 0.725235
Epoch 798
Validation auc = 0.727422
Epoch 799
Validation auc = 0.726711
Epoch 800
Validation auc = 0.718948
Epoch 801
Loss = 3.9333e-03, PNorm = 99.4138, GNorm = 0.1126, lr_0 = 9.6045e-04
Loss = 1.3140e-03, PNorm = 99.4177, GNorm = 0.0563, lr_0 = 9.6043e-04
Validation auc = 0.709545
Epoch 802
Validation auc = 0.702001
Epoch 803
Validation auc = 0.695987
Epoch 804
Validation auc = 0.710748
Epoch 805
Validation auc = 0.719440
Epoch 806
Loss = 3.6218e-03, PNorm = 99.4552, GNorm = 0.0440, lr_0 = 9.6019e-04
Loss = 1.2356e-04, PNorm = 99.4575, GNorm = 0.0034, lr_0 = 9.6018e-04
Validation auc = 0.720643
Epoch 807
Validation auc = 0.724798
Epoch 808
Validation auc = 0.722228
Epoch 809
Validation auc = 0.718128
Epoch 810
Validation auc = 0.715941
Epoch 811
Loss = 4.7008e-03, PNorm = 99.4774, GNorm = 0.1346, lr_0 = 9.5996e-04
Validation auc = 0.713153
Epoch 812
Validation auc = 0.716051
Epoch 813
Validation auc = 0.717691
Epoch 814
Validation auc = 0.723431
Epoch 815
Validation auc = 0.725399
Epoch 816
Loss = 1.0888e-03, PNorm = 99.5235, GNorm = 0.0261, lr_0 = 9.5970e-04
Validation auc = 0.725071
Epoch 817
Validation auc = 0.725071
Epoch 818
Validation auc = 0.724579
Epoch 819
Validation auc = 0.720424
Epoch 820
Loss = 6.3620e-03, PNorm = 99.5894, GNorm = 0.5572, lr_0 = 9.5948e-04
Loss = 6.5161e-05, PNorm = 99.5971, GNorm = 0.0020, lr_0 = 9.5946e-04
Validation auc = 0.716105
Epoch 821
Validation auc = 0.710201
Epoch 822
Validation auc = 0.705718
Epoch 823
Validation auc = 0.701345
Epoch 824
Validation auc = 0.696097
Epoch 825
Loss = 1.3896e-01, PNorm = 99.6737, GNorm = 0.6065, lr_0 = 9.5924e-04
Validation auc = 0.696753
Epoch 826
Validation auc = 0.694511
Epoch 827
Validation auc = 0.704133
Epoch 828
Validation auc = 0.727312
Epoch 829
Validation auc = 0.738082
Epoch 830
Loss = 3.7696e-02, PNorm = 99.7378, GNorm = 0.6773, lr_0 = 9.5899e-04
Validation auc = 0.743221
Epoch 831
Validation auc = 0.745462
Epoch 832
Validation auc = 0.746556
Epoch 833
Validation auc = 0.747649
Epoch 834
Loss = 1.3033e-02, PNorm = 99.7825, GNorm = 1.0445, lr_0 = 9.5877e-04
Loss = 2.3023e-03, PNorm = 99.7861, GNorm = 0.0989, lr_0 = 9.5875e-04
Validation auc = 0.748469
Epoch 835
Validation auc = 0.748797
Epoch 836
Validation auc = 0.747103
Epoch 837
Validation auc = 0.742510
Epoch 838
Validation auc = 0.744588
Epoch 839
Loss = 2.7864e-02, PNorm = 99.8194, GNorm = 0.0992, lr_0 = 9.5851e-04
Loss = 4.8336e-03, PNorm = 99.8219, GNorm = 0.1629, lr_0 = 9.5849e-04
Validation auc = 0.745353
Epoch 840
Validation auc = 0.744205
Epoch 841
Validation auc = 0.736387
Epoch 842
Validation auc = 0.726656
Epoch 843
Validation auc = 0.725563
Epoch 844
Loss = 1.5467e-02, PNorm = 99.8762, GNorm = 0.2871, lr_0 = 9.5827e-04
Validation auc = 0.729499
Epoch 845
Validation auc = 0.733873
Epoch 846
Validation auc = 0.738793
Epoch 847
Validation auc = 0.740925
Epoch 848
Validation auc = 0.741690
Epoch 849
Loss = 1.1047e-03, PNorm = 99.9398, GNorm = 0.0159, lr_0 = 9.5802e-04
Validation auc = 0.742292
Epoch 850
Validation auc = 0.741964
Epoch 851
Validation auc = 0.742073
Epoch 852
Validation auc = 0.742729
Epoch 853
Loss = 3.6613e-03, PNorm = 99.9803, GNorm = 0.0657, lr_0 = 9.5780e-04
Loss = 7.0897e-03, PNorm = 99.9837, GNorm = 0.1904, lr_0 = 9.5778e-04
Validation auc = 0.742292
Epoch 854
Validation auc = 0.743002
Epoch 855
Validation auc = 0.743385
Epoch 856
Validation auc = 0.744260
Epoch 857
Validation auc = 0.744916
Epoch 858
Loss = 2.5864e-03, PNorm = 100.0291, GNorm = 0.0429, lr_0 = 9.5754e-04
Validation auc = 0.746775
Epoch 859
Validation auc = 0.746611
Epoch 860
Validation auc = 0.744588
Epoch 861
Validation auc = 0.743057
Epoch 862
Validation auc = 0.742018
Epoch 863
Loss = 1.5655e-03, PNorm = 100.0656, GNorm = 0.0276, lr_0 = 9.5730e-04
Validation auc = 0.740433
Epoch 864
Validation auc = 0.736661
Epoch 865
Validation auc = 0.733326
Epoch 866
Validation auc = 0.730101
Epoch 867
Loss = 4.0629e-03, PNorm = 100.0871, GNorm = 0.0412, lr_0 = 9.5708e-04
Loss = 9.2512e-03, PNorm = 100.0899, GNorm = 0.3247, lr_0 = 9.5707e-04
Validation auc = 0.728461
Epoch 868
Validation auc = 0.728078
Epoch 869
Validation auc = 0.728406
Epoch 870
Validation auc = 0.727914
Epoch 871
Validation auc = 0.727640
Epoch 872
Loss = 4.5061e-02, PNorm = 100.1331, GNorm = 0.6989, lr_0 = 9.5683e-04
Loss = 4.7237e-04, PNorm = 100.1350, GNorm = 0.0117, lr_0 = 9.5681e-04
Validation auc = 0.726711
Epoch 873
Validation auc = 0.725618
Epoch 874
Validation auc = 0.725344
Epoch 875
Validation auc = 0.726110
Epoch 876
Validation auc = 0.727094
Epoch 877
Loss = 6.6656e-03, PNorm = 100.1655, GNorm = 0.0940, lr_0 = 9.5659e-04
Validation auc = 0.728023
Epoch 878
Validation auc = 0.727750
Epoch 879
Validation auc = 0.728133
Epoch 880
Validation auc = 0.728461
Epoch 881
Validation auc = 0.726055
Epoch 882
Loss = 6.3069e-03, PNorm = 100.1971, GNorm = 0.1366, lr_0 = 9.5634e-04
Validation auc = 0.724852
Epoch 883
Validation auc = 0.724470
Epoch 884
Validation auc = 0.724524
Epoch 885
Validation auc = 0.726000
Epoch 886
Loss = 2.7773e-04, PNorm = 100.2207, GNorm = 0.0059, lr_0 = 9.5612e-04
Loss = 5.1412e-05, PNorm = 100.2223, GNorm = 0.0022, lr_0 = 9.5610e-04
Validation auc = 0.727094
Epoch 887
Validation auc = 0.727367
Epoch 888
Validation auc = 0.727640
Epoch 889
Validation auc = 0.728242
Epoch 890
Validation auc = 0.728351
Epoch 891
Loss = 2.6315e-05, PNorm = 100.2376, GNorm = 0.0012, lr_0 = 9.5586e-04
Validation auc = 0.728351
Epoch 892
Validation auc = 0.728461
Epoch 893
Validation auc = 0.728461
Epoch 894
Validation auc = 0.728789
Epoch 895
Validation auc = 0.728953
Epoch 896
Loss = 2.3153e-05, PNorm = 100.2446, GNorm = 0.0010, lr_0 = 9.5563e-04
Validation auc = 0.729007
Epoch 897
Validation auc = 0.729062
Epoch 898
Validation auc = 0.729117
Epoch 899
Validation auc = 0.729062
Epoch 900
Loss = 8.6605e-02, PNorm = 100.2469, GNorm = 0.9107, lr_0 = 9.5541e-04
Loss = 2.0702e-05, PNorm = 100.2456, GNorm = 0.0008, lr_0 = 9.5539e-04
Validation auc = 0.728242
Epoch 901
Validation auc = 0.727039
Epoch 902
Validation auc = 0.725618
Epoch 903
Validation auc = 0.725180
Epoch 904
Validation auc = 0.724798
Epoch 905
Loss = 8.7175e-04, PNorm = 100.2471, GNorm = 0.0677, lr_0 = 9.5515e-04
Loss = 4.0984e-04, PNorm = 100.2481, GNorm = 0.0206, lr_0 = 9.5513e-04
Validation auc = 0.724688
Epoch 906
Validation auc = 0.724743
Epoch 907
Validation auc = 0.723704
Epoch 908
Validation auc = 0.722392
Epoch 909
Validation auc = 0.720807
Epoch 910
Loss = 4.5233e-04, PNorm = 100.2701, GNorm = 0.0135, lr_0 = 9.5491e-04
Validation auc = 0.720042
Epoch 911
Validation auc = 0.720096
Epoch 912
Validation auc = 0.720807
Epoch 913
Validation auc = 0.719714
Epoch 914
Validation auc = 0.718292
Epoch 915
Loss = 1.4886e-01, PNorm = 100.2874, GNorm = 1.4495, lr_0 = 9.5466e-04
Validation auc = 0.719112
Epoch 916
Validation auc = 0.727094
Epoch 917
Validation auc = 0.730265
Epoch 918
Validation auc = 0.732561
Epoch 919
Loss = 1.0961e-03, PNorm = 100.2956, GNorm = 0.0061, lr_0 = 9.5444e-04
Loss = 8.9650e-05, PNorm = 100.2970, GNorm = 0.0034, lr_0 = 9.5442e-04
Validation auc = 0.733217
Epoch 920
Validation auc = 0.733217
Epoch 921
Validation auc = 0.733599
Epoch 922
Validation auc = 0.733599
Epoch 923
Validation auc = 0.731303
Epoch 924
Loss = 1.8467e-04, PNorm = 100.3120, GNorm = 0.0069, lr_0 = 9.5419e-04
Validation auc = 0.728461
Epoch 925
Validation auc = 0.726930
Epoch 926
Validation auc = 0.725782
Epoch 927
Validation auc = 0.725782
Epoch 928
Validation auc = 0.725727
Epoch 929
Loss = 9.4057e-04, PNorm = 100.3216, GNorm = 0.0272, lr_0 = 9.5395e-04
Validation auc = 0.726547
Epoch 930
Validation auc = 0.727367
Epoch 931
Validation auc = 0.727859
Epoch 932
Validation auc = 0.727969
Epoch 933
Loss = 1.9247e-03, PNorm = 100.3410, GNorm = 0.0074, lr_0 = 9.5371e-04
Validation auc = 0.727039
Epoch 934
Validation auc = 0.725836
Epoch 935
Validation auc = 0.725344
Epoch 936
Validation auc = 0.724962
Epoch 937
Validation auc = 0.724524
Epoch 938
Loss = 6.7779e-02, PNorm = 100.3579, GNorm = 0.6051, lr_0 = 9.5348e-04
Loss = 3.2305e-04, PNorm = 100.3580, GNorm = 0.0094, lr_0 = 9.5346e-04
Validation auc = 0.723650
Epoch 939
Validation auc = 0.723376
Epoch 940
Validation auc = 0.723431
Epoch 941
Validation auc = 0.721463
Epoch 942
Validation auc = 0.720370
Epoch 943
Loss = 7.6658e-04, PNorm = 100.3662, GNorm = 0.0168, lr_0 = 9.5324e-04
Validation auc = 0.719331
Epoch 944
Validation auc = 0.718948
Epoch 945
Validation auc = 0.718565
Epoch 946
Validation auc = 0.718019
Epoch 947
Validation auc = 0.717035
Epoch 948
Loss = 1.1538e-03, PNorm = 100.3768, GNorm = 0.0256, lr_0 = 9.5299e-04
Validation auc = 0.716051
Epoch 949
Validation auc = 0.715340
Epoch 950
Validation auc = 0.714247
Epoch 951
Validation auc = 0.713153
Epoch 952
Loss = 4.0336e-03, PNorm = 100.3798, GNorm = 0.4681, lr_0 = 9.5277e-04
Loss = 2.8308e-03, PNorm = 100.3802, GNorm = 0.0625, lr_0 = 9.5275e-04
Validation auc = 0.713208
Epoch 953
Validation auc = 0.713700
Epoch 954
Validation auc = 0.715121
Epoch 955
Validation auc = 0.716215
Epoch 956
Validation auc = 0.716324
Epoch 957
Loss = 9.5689e-04, PNorm = 100.3985, GNorm = 0.0137, lr_0 = 9.5251e-04
Loss = 7.4966e-04, PNorm = 100.4000, GNorm = 0.0190, lr_0 = 9.5250e-04
Validation auc = 0.716160
Epoch 958
Validation auc = 0.716652
Epoch 959
Validation auc = 0.717144
Epoch 960
Validation auc = 0.717691
Epoch 961
Validation auc = 0.718128
Epoch 962
Loss = 3.8137e-04, PNorm = 100.4166, GNorm = 0.0103, lr_0 = 9.5228e-04
Validation auc = 0.718073
Epoch 963
Validation auc = 0.718073
Epoch 964
Validation auc = 0.717800
Epoch 965
Validation auc = 0.717417
Epoch 966
Loss = 3.0179e-03, PNorm = 100.4325, GNorm = 0.0076, lr_0 = 9.5204e-04
Validation auc = 0.719058
Epoch 967
Validation auc = 0.719331
Epoch 968
Validation auc = 0.720479
Epoch 969
Validation auc = 0.721408
Epoch 970
Validation auc = 0.721846
Epoch 971
Loss = 4.8447e-04, PNorm = 100.4463, GNorm = 0.0147, lr_0 = 9.5180e-04
Loss = 5.0820e-04, PNorm = 100.4476, GNorm = 0.0140, lr_0 = 9.5179e-04
Validation auc = 0.722392
Epoch 972
Validation auc = 0.722611
Epoch 973
Validation auc = 0.722666
Epoch 974
Validation auc = 0.722830
Epoch 975
Validation auc = 0.722720
Epoch 976
Loss = 2.9688e-04, PNorm = 100.4584, GNorm = 0.0062, lr_0 = 9.5157e-04
Validation auc = 0.722283
Epoch 977
Validation auc = 0.720862
Epoch 978
Validation auc = 0.719003
Epoch 979
Validation auc = 0.712771
Epoch 980
Validation auc = 0.706593
Epoch 981
Loss = 5.0153e-03, PNorm = 100.4772, GNorm = 0.1312, lr_0 = 9.5132e-04
Validation auc = 0.702766
Epoch 982
Validation auc = 0.705554
Epoch 983
Validation auc = 0.712443
Epoch 984
Validation auc = 0.717855
Epoch 985
Loss = 4.4874e-04, PNorm = 100.4993, GNorm = 0.0067, lr_0 = 9.5110e-04
Loss = 5.7888e-04, PNorm = 100.5008, GNorm = 0.0210, lr_0 = 9.5108e-04
Validation auc = 0.720971
Epoch 986
Validation auc = 0.721682
Epoch 987
Validation auc = 0.721736
Epoch 988
Validation auc = 0.722556
Epoch 989
Validation auc = 0.725126
Epoch 990
Loss = 1.0031e-03, PNorm = 100.5125, GNorm = 0.0076, lr_0 = 9.5084e-04
Loss = 2.2570e-04, PNorm = 100.5126, GNorm = 0.0067, lr_0 = 9.5083e-04
Validation auc = 0.726930
Epoch 991
Validation auc = 0.728679
Epoch 992
Validation auc = 0.728515
Epoch 993
Validation auc = 0.725672
Epoch 994
Validation auc = 0.722556
Epoch 995
Loss = 9.6537e-04, PNorm = 100.5141, GNorm = 0.0236, lr_0 = 9.5061e-04
Validation auc = 0.718675
Epoch 996
Validation auc = 0.721190
Epoch 997
Validation auc = 0.727640
Epoch 998
Validation auc = 0.730374
Epoch 999
Loss = 2.4822e-04, PNorm = 100.5339, GNorm = 0.0011, lr_0 = 9.5037e-04
Validation auc = 0.731795
Epoch 1000
Validation auc = 0.732178
Epoch 1001
Validation auc = 0.732561
Epoch 1002
Validation auc = 0.733053
Epoch 1003
Validation auc = 0.732561
Epoch 1004
Loss = 9.9402e-04, PNorm = 100.5597, GNorm = 0.0060, lr_0 = 9.5014e-04
Loss = 4.1232e-04, PNorm = 100.5620, GNorm = 0.0131, lr_0 = 9.5012e-04
Validation auc = 0.732451
Epoch 1005
Validation auc = 0.727422
Epoch 1006
Validation auc = 0.723431
Epoch 1007
Validation auc = 0.721354
Epoch 1008
Validation auc = 0.721026
Epoch 1009
Loss = 5.9037e-03, PNorm = 100.5902, GNorm = 0.3030, lr_0 = 9.4990e-04
Validation auc = 0.721135
Epoch 1010
Validation auc = 0.720916
Epoch 1011
Validation auc = 0.721846
Epoch 1012
Validation auc = 0.722666
Epoch 1013
Validation auc = 0.722939
Epoch 1014
Loss = 8.3034e-02, PNorm = 100.6208, GNorm = 0.5545, lr_0 = 9.4965e-04
Validation auc = 0.723212
Epoch 1015
Validation auc = 0.723322
Epoch 1016
Validation auc = 0.723267
Epoch 1017
Validation auc = 0.723759
Epoch 1018
Loss = 1.5706e-03, PNorm = 100.6328, GNorm = 0.1551, lr_0 = 9.4943e-04
Loss = 3.7567e-04, PNorm = 100.6337, GNorm = 0.0104, lr_0 = 9.4941e-04
Validation auc = 0.723923
Epoch 1019
Validation auc = 0.720862
Epoch 1020
Validation auc = 0.717636
Epoch 1021
Validation auc = 0.715941
Epoch 1022
Validation auc = 0.715723
Epoch 1023
Loss = 2.0923e-03, PNorm = 100.6561, GNorm = 0.0141, lr_0 = 9.4918e-04
Loss = 1.9222e-04, PNorm = 100.6579, GNorm = 0.0084, lr_0 = 9.4916e-04
Validation auc = 0.715449
Epoch 1024
Validation auc = 0.715340
Epoch 1025
Validation auc = 0.717472
Epoch 1026
Validation auc = 0.718511
Epoch 1027
Validation auc = 0.719714
Epoch 1028
Loss = 2.8276e-04, PNorm = 100.6805, GNorm = 0.0059, lr_0 = 9.4894e-04
Validation auc = 0.719932
Epoch 1029
Validation auc = 0.719659
Epoch 1030
Validation auc = 0.719331
Epoch 1031
Validation auc = 0.719386
Epoch 1032
Validation auc = 0.719222
Epoch 1033
Loss = 1.2411e-03, PNorm = 100.7021, GNorm = 0.0274, lr_0 = 9.4869e-04
Validation auc = 0.719003
Epoch 1034
Validation auc = 0.718401
Epoch 1035
Validation auc = 0.713591
Epoch 1036
Validation auc = 0.710529
Epoch 1037
Loss = 6.9139e-03, PNorm = 100.7111, GNorm = 0.4052, lr_0 = 9.4847e-04
Loss = 1.8349e-03, PNorm = 100.7133, GNorm = 0.0749, lr_0 = 9.4845e-04
Validation auc = 0.708069
Epoch 1038
Validation auc = 0.709654
Epoch 1039
Validation auc = 0.712443
Epoch 1040
Validation auc = 0.715231
Epoch 1041
Validation auc = 0.716160
Epoch 1042
Loss = 6.7279e-04, PNorm = 100.7381, GNorm = 0.0120, lr_0 = 9.4823e-04
Validation auc = 0.717199
Epoch 1043
Validation auc = 0.718401
Epoch 1044
Validation auc = 0.719495
Epoch 1045
Validation auc = 0.720151
Epoch 1046
Validation auc = 0.721080
Epoch 1047
Loss = 3.5131e-03, PNorm = 100.7539, GNorm = 0.2224, lr_0 = 9.4798e-04
Validation auc = 0.721518
Epoch 1048
Validation auc = 0.719495
Epoch 1049
Validation auc = 0.718511
Epoch 1050
Validation auc = 0.717472
Epoch 1051
Loss = 9.4571e-05, PNorm = 100.7626, GNorm = 0.0028, lr_0 = 9.4776e-04
Loss = 1.3343e-04, PNorm = 100.7631, GNorm = 0.0043, lr_0 = 9.4775e-04
Validation auc = 0.716816
Epoch 1052
Validation auc = 0.716761
Epoch 1053
Validation auc = 0.714684
Epoch 1054
Validation auc = 0.711513
Epoch 1055
Validation auc = 0.708124
Epoch 1056
Loss = 9.5439e-04, PNorm = 100.7786, GNorm = 0.0202, lr_0 = 9.4751e-04
Loss = 5.0222e-04, PNorm = 100.7800, GNorm = 0.0186, lr_0 = 9.4749e-04
Validation auc = 0.705336
Epoch 1057
Validation auc = 0.703860
Epoch 1058
Validation auc = 0.703149
Epoch 1059
Validation auc = 0.703258
Epoch 1060
Validation auc = 0.704680
Epoch 1061
Loss = 9.6047e-04, PNorm = 100.7981, GNorm = 0.0272, lr_0 = 9.4728e-04
Validation auc = 0.705664
Epoch 1062
Validation auc = 0.707468
Epoch 1063
Validation auc = 0.709053
Epoch 1064
Validation auc = 0.708233
Epoch 1065
Validation auc = 0.706921
Epoch 1066
Loss = 4.1465e-04, PNorm = 100.8099, GNorm = 0.0077, lr_0 = 9.4702e-04
Validation auc = 0.706210
Epoch 1067
Validation auc = 0.706265
Epoch 1068
Validation auc = 0.706210
Epoch 1069
Validation auc = 0.706210
Epoch 1070
Loss = 6.1595e-04, PNorm = 100.8159, GNorm = 0.0047, lr_0 = 9.4681e-04
Loss = 1.2123e-04, PNorm = 100.8164, GNorm = 0.0041, lr_0 = 9.4679e-04
Validation auc = 0.706156
Epoch 1071
Validation auc = 0.706156
Epoch 1072
Validation auc = 0.706265
Epoch 1073
Validation auc = 0.706374
Epoch 1074
Validation auc = 0.707030
Epoch 1075
Loss = 2.7011e-04, PNorm = 100.8235, GNorm = 0.0052, lr_0 = 9.4657e-04
Validation auc = 0.707085
Epoch 1076
Validation auc = 0.707140
Epoch 1077
Validation auc = 0.707413
Epoch 1078
Validation auc = 0.707632
Epoch 1079
Validation auc = 0.707632
Epoch 1080
Loss = 1.0234e-04, PNorm = 100.8296, GNorm = 0.0024, lr_0 = 9.4632e-04
Validation auc = 0.707686
Epoch 1081
Validation auc = 0.707741
Epoch 1082
Validation auc = 0.707850
Epoch 1083
Validation auc = 0.707796
Epoch 1084
Loss = 1.2237e-04, PNorm = 100.8338, GNorm = 0.0024, lr_0 = 9.4610e-04
Loss = 5.1306e-04, PNorm = 100.8341, GNorm = 0.0237, lr_0 = 9.4608e-04
Validation auc = 0.707741
Epoch 1085
Validation auc = 0.707960
Epoch 1086
Validation auc = 0.708124
Epoch 1087
Validation auc = 0.708342
Epoch 1088
Validation auc = 0.708397
Epoch 1089
Loss = 1.4653e-04, PNorm = 100.8386, GNorm = 0.0035, lr_0 = 9.4585e-04
Loss = 9.4968e-06, PNorm = 100.8388, GNorm = 0.0005, lr_0 = 9.4583e-04
Validation auc = 0.708670
Epoch 1090
Validation auc = 0.708725
Epoch 1091
Validation auc = 0.708780
Epoch 1092
Validation auc = 0.708889
Epoch 1093
Validation auc = 0.705445
Epoch 1094
Loss = 8.7978e-04, PNorm = 100.8328, GNorm = 0.0213, lr_0 = 9.4561e-04
Validation auc = 0.704953
Epoch 1095
Validation auc = 0.707413
Epoch 1096
Validation auc = 0.710912
Epoch 1097
Validation auc = 0.715121
Epoch 1098
Validation auc = 0.718948
Epoch 1099
Loss = 9.1111e-04, PNorm = 100.8545, GNorm = 0.0196, lr_0 = 9.4536e-04
Validation auc = 0.721736
Epoch 1100
Validation auc = 0.724360
Epoch 1101
Validation auc = 0.721900
Epoch 1102
Validation auc = 0.712115
Epoch 1103
Loss = 2.5998e-02, PNorm = 100.9102, GNorm = 0.9280, lr_0 = 9.4515e-04
Loss = 3.3299e-04, PNorm = 100.9151, GNorm = 0.0117, lr_0 = 9.4513e-04
Validation auc = 0.710584
Epoch 1104
Validation auc = 0.714520
Epoch 1105
Validation auc = 0.720260
Epoch 1106
Validation auc = 0.726602
Epoch 1107
Validation auc = 0.727805
Epoch 1108
Loss = 4.9689e-03, PNorm = 100.9740, GNorm = 0.4765, lr_0 = 9.4489e-04
Validation auc = 0.729062
Epoch 1109
Validation auc = 0.730647
Epoch 1110
Validation auc = 0.731467
Epoch 1111
Validation auc = 0.733326
Epoch 1112
Validation auc = 0.734911
Epoch 1113
Loss = 4.6881e-02, PNorm = 101.0150, GNorm = 1.3756, lr_0 = 9.4466e-04
Validation auc = 0.729773
Epoch 1114
Validation auc = 0.725946
Epoch 1115
Validation auc = 0.723376
Epoch 1116
Validation auc = 0.720807
Epoch 1117
Loss = 8.7680e-04, PNorm = 101.0448, GNorm = 0.0176, lr_0 = 9.4444e-04
Loss = 1.1351e-03, PNorm = 101.0468, GNorm = 0.0391, lr_0 = 9.4443e-04
Validation auc = 0.717964
Epoch 1118
Validation auc = 0.716707
Epoch 1119
Validation auc = 0.715613
Epoch 1120
Validation auc = 0.715449
Epoch 1121
Validation auc = 0.715285
Epoch 1122
Loss = 4.1806e-04, PNorm = 101.0689, GNorm = 0.0045, lr_0 = 9.4419e-04
Loss = 4.3002e-04, PNorm = 101.0701, GNorm = 0.0130, lr_0 = 9.4417e-04
Validation auc = 0.715395
Epoch 1123
Validation auc = 0.715723
Epoch 1124
Validation auc = 0.715832
Epoch 1125
Validation auc = 0.715996
Epoch 1126
Validation auc = 0.716215
Epoch 1127
Loss = 1.1971e-04, PNorm = 101.0828, GNorm = 0.0039, lr_0 = 9.4396e-04
Validation auc = 0.716543
Epoch 1128
Validation auc = 0.717417
Epoch 1129
Validation auc = 0.718565
Epoch 1130
Validation auc = 0.719112
Epoch 1131
Validation auc = 0.719495
Epoch 1132
Loss = 2.5097e-04, PNorm = 101.0969, GNorm = 0.0070, lr_0 = 9.4371e-04
Validation auc = 0.720096
Epoch 1133
Validation auc = 0.720260
Epoch 1134
Validation auc = 0.720752
Epoch 1135
Validation auc = 0.720096
Epoch 1136
Loss = 2.8474e-04, PNorm = 101.1039, GNorm = 0.0092, lr_0 = 9.4349e-04
Loss = 7.7892e-04, PNorm = 101.1046, GNorm = 0.0360, lr_0 = 9.4347e-04
Validation auc = 0.717199
Epoch 1137
Validation auc = 0.715613
Epoch 1138
Validation auc = 0.714356
Epoch 1139
Validation auc = 0.710639
Epoch 1140
Validation auc = 0.707632
Epoch 1141
Loss = 1.8416e-04, PNorm = 101.1359, GNorm = 0.0028, lr_0 = 9.4324e-04
Validation auc = 0.706757
Epoch 1142
Validation auc = 0.705062
Epoch 1143
Validation auc = 0.704406
Epoch 1144
Validation auc = 0.703422
Epoch 1145
Validation auc = 0.702712
Epoch 1146
Loss = 4.3295e-05, PNorm = 101.1616, GNorm = 0.0014, lr_0 = 9.4300e-04
Validation auc = 0.702220
Epoch 1147
Validation auc = 0.703586
Epoch 1148
Validation auc = 0.702985
Epoch 1149
Validation auc = 0.702712
Epoch 1150
Loss = 1.7378e-03, PNorm = 101.1802, GNorm = 0.0132, lr_0 = 9.4279e-04
Loss = 6.5891e-05, PNorm = 101.1817, GNorm = 0.0035, lr_0 = 9.4277e-04
Validation auc = 0.703696
Epoch 1151
Validation auc = 0.703969
Epoch 1152
Validation auc = 0.703750
Epoch 1153
Validation auc = 0.704024
Epoch 1154
Validation auc = 0.704297
Epoch 1155
Loss = 1.9486e-03, PNorm = 101.2133, GNorm = 0.2776, lr_0 = 9.4253e-04
Loss = 1.7662e-05, PNorm = 101.2154, GNorm = 0.0008, lr_0 = 9.4252e-04
Validation auc = 0.704625
Epoch 1156
Validation auc = 0.705609
Epoch 1157
Validation auc = 0.706538
Epoch 1158
Validation auc = 0.708233
Epoch 1159
Validation auc = 0.708944
Epoch 1160
Loss = 6.3043e-04, PNorm = 101.2372, GNorm = 0.0308, lr_0 = 9.4230e-04
Validation auc = 0.708506
Epoch 1161
Validation auc = 0.708342
Epoch 1162
Validation auc = 0.709217
Epoch 1163
Validation auc = 0.710092
Epoch 1164
Validation auc = 0.710639
Epoch 1165
Loss = 3.5858e-04, PNorm = 101.2595, GNorm = 0.0233, lr_0 = 9.4205e-04
Validation auc = 0.711295
Epoch 1166
Validation auc = 0.711459
Epoch 1167
Validation auc = 0.711349
Epoch 1168
Validation auc = 0.711677
Epoch 1169
Loss = 1.6690e-03, PNorm = 101.2762, GNorm = 0.0003, lr_0 = 9.4183e-04
Loss = 2.7814e-05, PNorm = 101.2773, GNorm = 0.0013, lr_0 = 9.4182e-04
Validation auc = 0.709928
Epoch 1170
Validation auc = 0.709217
Epoch 1171
Validation auc = 0.708725
Epoch 1172
Validation auc = 0.708397
Epoch 1173
Validation auc = 0.708124
Epoch 1174
Loss = 1.9984e-04, PNorm = 101.2873, GNorm = 0.0324, lr_0 = 9.4158e-04
Validation auc = 0.707850
Epoch 1175
Validation auc = 0.707468
Epoch 1176
Validation auc = 0.706976
Epoch 1177
Validation auc = 0.706648
Epoch 1178
Validation auc = 0.706210
Epoch 1179
Loss = 3.7660e-04, PNorm = 101.2921, GNorm = 0.0283, lr_0 = 9.4135e-04
Validation auc = 0.705062
Epoch 1180
Validation auc = 0.704953
Epoch 1181
Validation auc = 0.704024
Epoch 1182
Validation auc = 0.703696
Epoch 1183
Loss = 3.5521e-04, PNorm = 101.2898, GNorm = 0.0216, lr_0 = 9.4112e-04
Validation auc = 0.703477
Epoch 1184
Validation auc = 0.703313
Epoch 1185
Validation auc = 0.703204
Epoch 1186
Validation auc = 0.703258
Epoch 1187
Validation auc = 0.703258
Epoch 1188
Loss = 7.8949e-04, PNorm = 101.2958, GNorm = 0.0080, lr_0 = 9.4088e-04
Loss = 3.5998e-05, PNorm = 101.2964, GNorm = 0.0020, lr_0 = 9.4087e-04
Validation auc = 0.702821
Epoch 1189
Validation auc = 0.702548
Epoch 1190
Validation auc = 0.702766
Epoch 1191
Validation auc = 0.703094
Epoch 1192
Validation auc = 0.703204
Epoch 1193
Loss = 1.0361e-04, PNorm = 101.3036, GNorm = 0.0029, lr_0 = 9.4065e-04
Validation auc = 0.703586
Epoch 1194
Validation auc = 0.703477
Epoch 1195
Validation auc = 0.703586
Epoch 1196
Validation auc = 0.703641
Epoch 1197
Validation auc = 0.703750
Epoch 1198
Loss = 2.1203e-05, PNorm = 101.3107, GNorm = 0.0006, lr_0 = 9.4040e-04
Validation auc = 0.703914
Epoch 1199
Validation auc = 0.703696
Epoch 1200
Validation auc = 0.703696
Epoch 1201
Validation auc = 0.699814
Epoch 1202
Loss = 1.1546e-04, PNorm = 101.3221, GNorm = 0.0034, lr_0 = 9.4018e-04
Loss = 9.7399e-05, PNorm = 101.3235, GNorm = 0.0051, lr_0 = 9.4016e-04
Validation auc = 0.697627
Epoch 1203
Validation auc = 0.695659
Epoch 1204
Validation auc = 0.694894
Epoch 1205
Validation auc = 0.693965
Epoch 1206
Validation auc = 0.693309
Epoch 1207
Loss = 4.1708e-04, PNorm = 101.3376, GNorm = 0.0125, lr_0 = 9.3993e-04
Loss = 1.7762e-05, PNorm = 101.3383, GNorm = 0.0008, lr_0 = 9.3991e-04
Validation auc = 0.693309
Epoch 1208
Validation auc = 0.693309
Epoch 1209
Validation auc = 0.693473
Epoch 1210
Validation auc = 0.693691
Epoch 1211
Validation auc = 0.693965
Epoch 1212
Loss = 6.3240e-05, PNorm = 101.3457, GNorm = 0.0024, lr_0 = 9.3970e-04
Validation auc = 0.694129
Epoch 1213
Validation auc = 0.694074
Epoch 1214
Validation auc = 0.694402
Epoch 1215
Validation auc = 0.695003
Epoch 1216
Loss = 9.9746e-04, PNorm = 101.3522, GNorm = 0.0003, lr_0 = 9.3946e-04
Validation auc = 0.692817
Epoch 1217
Validation auc = 0.691176
Epoch 1218
Validation auc = 0.690247
Epoch 1219
Validation auc = 0.689536
Epoch 1220
Validation auc = 0.688552
Epoch 1221
Loss = 1.1885e-04, PNorm = 101.3575, GNorm = 0.0039, lr_0 = 9.3923e-04
Loss = 8.2977e-04, PNorm = 101.3579, GNorm = 0.0330, lr_0 = 9.3922e-04
Validation auc = 0.688224
Epoch 1222
Validation auc = 0.688279
Epoch 1223
Validation auc = 0.688224
Epoch 1224
Validation auc = 0.688498
Epoch 1225
Validation auc = 0.688443
Epoch 1226
Loss = 5.9551e-05, PNorm = 101.3627, GNorm = 0.0021, lr_0 = 9.3900e-04
Validation auc = 0.688279
Epoch 1227
Validation auc = 0.688388
Epoch 1228
Validation auc = 0.688498
Epoch 1229
Validation auc = 0.688388
Epoch 1230
Validation auc = 0.688716
Epoch 1231
Loss = 9.0564e-05, PNorm = 101.3672, GNorm = 0.0025, lr_0 = 9.3875e-04
Validation auc = 0.688607
Epoch 1232
Validation auc = 0.688552
Epoch 1233
Validation auc = 0.688443
Epoch 1234
Validation auc = 0.688388
Epoch 1235
Loss = 8.0143e-04, PNorm = 101.3707, GNorm = 0.0024, lr_0 = 9.3853e-04
Loss = 5.9604e-06, PNorm = 101.3710, GNorm = 0.0004, lr_0 = 9.3852e-04
Validation auc = 0.688279
Epoch 1236
Validation auc = 0.688224
Epoch 1237
Validation auc = 0.688443
Epoch 1238
Validation auc = 0.688443
Epoch 1239
Validation auc = 0.688662
Epoch 1240
Loss = 3.2695e-05, PNorm = 101.3764, GNorm = 0.0006, lr_0 = 9.3828e-04
Loss = 4.0134e-06, PNorm = 101.3766, GNorm = 0.0002, lr_0 = 9.3827e-04
Validation auc = 0.688443
Epoch 1241
Validation auc = 0.688115
Epoch 1242
Validation auc = 0.689810
Epoch 1243
Validation auc = 0.689427
Epoch 1244
Validation auc = 0.689044
Epoch 1245
Loss = 9.4497e-05, PNorm = 101.3937, GNorm = 0.0032, lr_0 = 9.3805e-04
Validation auc = 0.691231
Epoch 1246
Validation auc = 0.697573
Epoch 1247
Validation auc = 0.686584
Epoch 1248
Validation auc = 0.678985
Epoch 1249
Loss = 3.8085e-01, PNorm = 101.5771, GNorm = 0.0767, lr_0 = 9.3782e-04
Validation auc = 0.689646
Epoch 1250
Validation auc = 0.703258
Epoch 1251
Validation auc = 0.704406
Epoch 1252
Validation auc = 0.710037
Epoch 1253
Validation auc = 0.742182
Epoch 1254
Loss = 1.1668e-01, PNorm = 102.1332, GNorm = 0.5164, lr_0 = 9.3758e-04
Loss = 1.8184e-01, PNorm = 102.1734, GNorm = 2.0853, lr_0 = 9.3757e-04
Validation auc = 0.743494
Epoch 1255
Validation auc = 0.734419
Epoch 1256
Validation auc = 0.714684
Epoch 1257
Validation auc = 0.694511
Epoch 1258
Validation auc = 0.682648
Epoch 1259
Loss = 4.7367e-03, PNorm = 102.5934, GNorm = 0.0637, lr_0 = 9.3735e-04
Validation auc = 0.675924
Epoch 1260
Validation auc = 0.694457
Epoch 1261
Validation auc = 0.702712
Epoch 1262
Validation auc = 0.730429
Epoch 1263
Validation auc = 0.741854
Epoch 1264
Loss = 9.5113e-02, PNorm = 102.9041, GNorm = 2.9942, lr_0 = 9.3710e-04
Validation auc = 0.745353
Epoch 1265
Validation auc = 0.739066
Epoch 1266
Validation auc = 0.728734
Epoch 1267
Validation auc = 0.714356
Epoch 1268
Loss = 2.1708e-02, PNorm = 103.1874, GNorm = 0.3252, lr_0 = 9.3689e-04
Loss = 4.2804e-02, PNorm = 103.2099, GNorm = 3.1527, lr_0 = 9.3687e-04
Validation auc = 0.705554
Epoch 1269
Validation auc = 0.716105
Epoch 1270
Validation auc = 0.733927
Epoch 1271
Validation auc = 0.749563
Epoch 1272
Validation auc = 0.744205
Epoch 1273
Loss = 1.4460e-01, PNorm = 103.5062, GNorm = 1.0267, lr_0 = 9.3664e-04
Loss = 3.5734e-02, PNorm = 103.5238, GNorm = 0.8334, lr_0 = 9.3662e-04
Validation auc = 0.744150
Epoch 1274
Validation auc = 0.740761
Epoch 1275
Validation auc = 0.737208
Epoch 1276
Validation auc = 0.734693
Epoch 1277
Validation auc = 0.732014
Epoch 1278
Loss = 2.5728e-03, PNorm = 103.7060, GNorm = 0.0476, lr_0 = 9.3641e-04
Validation auc = 0.729390
Epoch 1279
Validation auc = 0.728242
Epoch 1280
Validation auc = 0.727094
Epoch 1281
Validation auc = 0.706156
Epoch 1282
Validation auc = 0.688716
Epoch 1283
Loss = 2.5857e-02, PNorm = 103.8293, GNorm = 1.7904, lr_0 = 9.3616e-04
Validation auc = 0.705117
Epoch 1284
Validation auc = 0.696315
Epoch 1285
Validation auc = 0.639187
Epoch 1286
Validation auc = 0.626285
Epoch 1287
Loss = 2.2484e-02, PNorm = 104.0808, GNorm = 0.1172, lr_0 = 9.3594e-04
Loss = 2.8736e-01, PNorm = 104.1050, GNorm = 4.8224, lr_0 = 9.3592e-04
Validation auc = 0.657118
Epoch 1288
Validation auc = 0.624535
Epoch 1289
Validation auc = 0.628799
Epoch 1290
Validation auc = 0.639515
Epoch 1291
Validation auc = 0.647660
Epoch 1292
Loss = 5.9632e-02, PNorm = 104.3634, GNorm = 0.9102, lr_0 = 9.3571e-04
Validation auc = 0.648316
Epoch 1293
Validation auc = 0.649191
Epoch 1294
Validation auc = 0.657938
Epoch 1295
Validation auc = 0.670676
Epoch 1296
Validation auc = 0.674229
Epoch 1297
Loss = 1.6947e-02, PNorm = 104.5702, GNorm = 0.1625, lr_0 = 9.3546e-04
Validation auc = 0.670020
Epoch 1298
Validation auc = 0.666029
Epoch 1299
Validation auc = 0.663241
Epoch 1300
Validation auc = 0.656735
Epoch 1301
Loss = 6.9521e-03, PNorm = 104.7155, GNorm = 0.1931, lr_0 = 9.3524e-04
Loss = 1.2312e-03, PNorm = 104.7254, GNorm = 0.0329, lr_0 = 9.3523e-04
Validation auc = 0.657227
Epoch 1302
Validation auc = 0.660562
Epoch 1303
Validation auc = 0.662530
Epoch 1304
Validation auc = 0.666302
Epoch 1305
Validation auc = 0.668270
Epoch 1306
Loss = 3.4202e-03, PNorm = 104.8297, GNorm = 0.0080, lr_0 = 9.3499e-04
Loss = 1.8378e-04, PNorm = 104.8347, GNorm = 0.0055, lr_0 = 9.3498e-04
Validation auc = 0.668708
Epoch 1307
Validation auc = 0.668762
Epoch 1308
Validation auc = 0.669036
Epoch 1309
Validation auc = 0.669036
Epoch 1310
Validation auc = 0.671113
Epoch 1311
Loss = 1.0704e-02, PNorm = 104.8903, GNorm = 1.1507, lr_0 = 9.3476e-04
Validation auc = 0.676580
Epoch 1312
Validation auc = 0.683851
Epoch 1313
Validation auc = 0.688662
Epoch 1314
Validation auc = 0.691395
Epoch 1315
Validation auc = 0.693910
Epoch 1316
Loss = 4.6278e-04, PNorm = 104.9611, GNorm = 0.0250, lr_0 = 9.3451e-04
Validation auc = 0.696370
Epoch 1317
Validation auc = 0.697026
Epoch 1318
Validation auc = 0.686202
Epoch 1319
Validation auc = 0.677127
Epoch 1320
Loss = 7.2217e-04, PNorm = 105.0148, GNorm = 0.0225, lr_0 = 9.3430e-04
Loss = 8.4192e-04, PNorm = 105.0197, GNorm = 0.0268, lr_0 = 9.3428e-04
Validation auc = 0.669473
Epoch 1321
Validation auc = 0.665099
Epoch 1322
Validation auc = 0.660781
Epoch 1323
Validation auc = 0.663405
Epoch 1324
Validation auc = 0.668489
Epoch 1325
Loss = 9.3405e-04, PNorm = 105.0859, GNorm = 0.0506, lr_0 = 9.3407e-04
Validation auc = 0.665099
Epoch 1326
Validation auc = 0.693965
Epoch 1327
Validation auc = 0.703477
Epoch 1328
Validation auc = 0.710967
Epoch 1329
Validation auc = 0.710529
Epoch 1330
Loss = 2.4505e-03, PNorm = 105.2060, GNorm = 0.1484, lr_0 = 9.3382e-04
Validation auc = 0.707140
Epoch 1331
Validation auc = 0.702657
Epoch 1332
Validation auc = 0.702384
Epoch 1333
Validation auc = 0.704297
Epoch 1334
Loss = 1.7028e-03, PNorm = 105.3185, GNorm = 0.0340, lr_0 = 9.3360e-04
Loss = 6.0472e-05, PNorm = 105.3257, GNorm = 0.0024, lr_0 = 9.3359e-04
Validation auc = 0.702493
Epoch 1335
Validation auc = 0.702165
Epoch 1336
Validation auc = 0.694183
Epoch 1337
Validation auc = 0.686639
Epoch 1338
Validation auc = 0.687568
Epoch 1339
Loss = 3.2742e-02, PNorm = 105.3769, GNorm = 0.0653, lr_0 = 9.3336e-04
Loss = 4.9128e-05, PNorm = 105.3840, GNorm = 0.0016, lr_0 = 9.3334e-04
Validation auc = 0.692434
Epoch 1340
Validation auc = 0.697518
Epoch 1341
Validation auc = 0.698393
Epoch 1342
Validation auc = 0.697354
Epoch 1343
Validation auc = 0.701236
Epoch 1344
Loss = 2.8817e-02, PNorm = 105.6288, GNorm = 0.3696, lr_0 = 9.3312e-04
Validation auc = 0.703040
Epoch 1345
Validation auc = 0.704188
Epoch 1346
Validation auc = 0.708998
Epoch 1347
Validation auc = 0.727914
Epoch 1348
Validation auc = 0.711295
Epoch 1349
Loss = 1.4609e-02, PNorm = 105.8831, GNorm = 0.1638, lr_0 = 9.3288e-04
Validation auc = 0.705226
Epoch 1350
Validation auc = 0.699978
Epoch 1351
Validation auc = 0.695003
Epoch 1352
Validation auc = 0.690247
Epoch 1353
Loss = 2.2072e-02, PNorm = 106.0990, GNorm = 0.1778, lr_0 = 9.3266e-04
Loss = 2.5774e-03, PNorm = 106.1135, GNorm = 0.0867, lr_0 = 9.3264e-04
Validation auc = 0.687350
Epoch 1354
Validation auc = 0.686803
Epoch 1355
Validation auc = 0.687404
Epoch 1356
Validation auc = 0.685710
Epoch 1357
Validation auc = 0.684780
Epoch 1358
Loss = 1.0731e-02, PNorm = 106.2585, GNorm = 0.0818, lr_0 = 9.3241e-04
Validation auc = 0.685600
Epoch 1359
Validation auc = 0.682867
Epoch 1360
Validation auc = 0.680297
Epoch 1361
Validation auc = 0.683250
Epoch 1362
Validation auc = 0.689536
Epoch 1363
Loss = 1.5199e-01, PNorm = 106.3349, GNorm = 1.6271, lr_0 = 9.3218e-04
Validation auc = 0.689591
Epoch 1364
Validation auc = 0.690630
Epoch 1365
Validation auc = 0.691340
Epoch 1366
Validation auc = 0.692871
Epoch 1367
Loss = 6.1116e-03, PNorm = 106.3815, GNorm = 0.2899, lr_0 = 9.3197e-04
Loss = 7.7916e-05, PNorm = 106.3859, GNorm = 0.0030, lr_0 = 9.3195e-04
Validation auc = 0.697791
Epoch 1368
Validation auc = 0.701072
Epoch 1369
Validation auc = 0.701126
Epoch 1370
Validation auc = 0.700908
Epoch 1371
Validation auc = 0.697354
Epoch 1372
Loss = 2.1934e-03, PNorm = 106.4416, GNorm = 0.0605, lr_0 = 9.3172e-04
Loss = 2.4451e-04, PNorm = 106.4449, GNorm = 0.0112, lr_0 = 9.3170e-04
Validation auc = 0.692871
Epoch 1373
Validation auc = 0.688552
Epoch 1374
Validation auc = 0.684452
Epoch 1375
Validation auc = 0.681063
Epoch 1376
Validation auc = 0.679259
Epoch 1377
Loss = 8.9740e-04, PNorm = 106.4868, GNorm = 0.0263, lr_0 = 9.3149e-04
Validation auc = 0.678493
Epoch 1378
Validation auc = 0.676471
Epoch 1379
Validation auc = 0.673081
Epoch 1380
Validation auc = 0.675213
Epoch 1381
Validation auc = 0.688552
Epoch 1382
Loss = 6.3983e-03, PNorm = 106.5528, GNorm = 0.2913, lr_0 = 9.3124e-04
Validation auc = 0.696917
Epoch 1383
Validation auc = 0.701509
Epoch 1384
Validation auc = 0.703586
Epoch 1385
Validation auc = 0.701072
Epoch 1386
Loss = 9.8801e-02, PNorm = 106.7108, GNorm = 0.5543, lr_0 = 9.3102e-04
Loss = 4.9083e-01, PNorm = 106.7261, GNorm = 10.9537, lr_0 = 9.3101e-04
Validation auc = 0.695878
Epoch 1387
Validation auc = 0.689044
Epoch 1388
Validation auc = 0.686912
Epoch 1389
Validation auc = 0.680024
Epoch 1390
Validation auc = 0.672972
Epoch 1391
Loss = 2.2684e-02, PNorm = 106.9423, GNorm = 0.1369, lr_0 = 9.3078e-04
Validation auc = 0.668653
Epoch 1392
Validation auc = 0.672534
Epoch 1393
Validation auc = 0.657391
Epoch 1394
Validation auc = 0.654876
Epoch 1395
Validation auc = 0.652034
Epoch 1396
Loss = 7.9498e-03, PNorm = 107.1130, GNorm = 0.1325, lr_0 = 9.3055e-04
Validation auc = 0.648918
Epoch 1397
Validation auc = 0.646348
Epoch 1398
Validation auc = 0.646512
Epoch 1399
Validation auc = 0.647770
Epoch 1400
Loss = 6.8716e-03, PNorm = 107.2451, GNorm = 0.2304, lr_0 = 9.3033e-04
Loss = 8.0242e-04, PNorm = 107.2534, GNorm = 0.0410, lr_0 = 9.3032e-04
Validation auc = 0.648152
Epoch 1401
Validation auc = 0.647606
Epoch 1402
Validation auc = 0.646129
Epoch 1403
Validation auc = 0.646621
Epoch 1404
Validation auc = 0.647387
Epoch 1405
Loss = 1.6193e-03, PNorm = 107.3415, GNorm = 0.0427, lr_0 = 9.3008e-04
Loss = 5.3161e-03, PNorm = 107.3462, GNorm = 0.1605, lr_0 = 9.3007e-04
Validation auc = 0.648918
Epoch 1406
Validation auc = 0.649902
Epoch 1407
Validation auc = 0.650612
Epoch 1408
Validation auc = 0.651378
Epoch 1409
Validation auc = 0.652526
Epoch 1410
Loss = 2.6831e-03, PNorm = 107.3892, GNorm = 0.0740, lr_0 = 9.2985e-04
Validation auc = 0.651159
Epoch 1411
Validation auc = 0.651432
Epoch 1412
Validation auc = 0.651706
Epoch 1413
Validation auc = 0.651815
Epoch 1414
Validation auc = 0.652526
Epoch 1415
Loss = 6.5554e-02, PNorm = 107.4346, GNorm = 1.5332, lr_0 = 9.2961e-04
Validation auc = 0.652362
Epoch 1416
Validation auc = 0.653674
Epoch 1417
Validation auc = 0.654002
Epoch 1418
Validation auc = 0.653182
Epoch 1419
Loss = 4.7094e-04, PNorm = 107.4673, GNorm = 0.0131, lr_0 = 9.2939e-04
Loss = 9.7116e-05, PNorm = 107.4700, GNorm = 0.0032, lr_0 = 9.2938e-04
Validation auc = 0.652307
Epoch 1420
Validation auc = 0.661382
Epoch 1421
Validation auc = 0.668106
Epoch 1422
Validation auc = 0.671386
Epoch 1423
Validation auc = 0.670676
Epoch 1424
Loss = 2.8475e-02, PNorm = 107.5308, GNorm = 0.1345, lr_0 = 9.2914e-04
Validation auc = 0.656790
Epoch 1425
Validation auc = 0.642904
Epoch 1426
Validation auc = 0.634212
Epoch 1427
Validation auc = 0.630112
Epoch 1428
Validation auc = 0.626831
Epoch 1429
Loss = 1.0324e-01, PNorm = 107.6698, GNorm = 1.9534, lr_0 = 9.2891e-04
Validation auc = 0.623387
Epoch 1430
Validation auc = 0.623059
Epoch 1431
Validation auc = 0.624262
Epoch 1432
Validation auc = 0.625355
Epoch 1433
Loss = 5.8697e-03, PNorm = 107.7746, GNorm = 0.0208, lr_0 = 9.2868e-04
Validation auc = 0.627487
Epoch 1434
Validation auc = 0.628471
Epoch 1435
Validation auc = 0.630057
Epoch 1436
Validation auc = 0.633665
Epoch 1437
Validation auc = 0.636180
Epoch 1438
Loss = 6.9168e-03, PNorm = 107.8529, GNorm = 0.1642, lr_0 = 9.2845e-04
Loss = 5.6411e-03, PNorm = 107.8582, GNorm = 0.2453, lr_0 = 9.2844e-04
Validation auc = 0.638804
Epoch 1439
Validation auc = 0.646184
Epoch 1440
Validation auc = 0.652580
Epoch 1441
Validation auc = 0.659578
Epoch 1442
Validation auc = 0.663897
Epoch 1443
Loss = 6.1301e-04, PNorm = 107.9284, GNorm = 0.0123, lr_0 = 9.2822e-04
Validation auc = 0.668653
Epoch 1444
Validation auc = 0.673846
Epoch 1445
Validation auc = 0.681391
Epoch 1446
Validation auc = 0.673464
Epoch 1447
Validation auc = 0.658922
Epoch 1448
Loss = 1.1199e-03, PNorm = 108.0142, GNorm = 0.0201, lr_0 = 9.2798e-04
Validation auc = 0.649902
Epoch 1449
Validation auc = 0.644380
Epoch 1450
Validation auc = 0.647770
Epoch 1451
Validation auc = 0.666740
Epoch 1452
Loss = 2.8261e-02, PNorm = 108.1234, GNorm = 1.3389, lr_0 = 9.2776e-04
Loss = 1.3499e-02, PNorm = 108.1401, GNorm = 0.3069, lr_0 = 9.2775e-04
Validation auc = 0.668106
Epoch 1453
Validation auc = 0.661983
Epoch 1454
Validation auc = 0.656954
Epoch 1455
Validation auc = 0.653838
Epoch 1456
Validation auc = 0.650558
Epoch 1457
Loss = 3.8252e-03, PNorm = 108.3346, GNorm = 0.0725, lr_0 = 9.2752e-04
Loss = 2.4173e-04, PNorm = 108.3429, GNorm = 0.0069, lr_0 = 9.2750e-04
Validation auc = 0.647934
Epoch 1458
Validation auc = 0.648371
Epoch 1459
Validation auc = 0.649082
Epoch 1460
Validation auc = 0.649464
Epoch 1461
Validation auc = 0.649082
Epoch 1462
Loss = 1.9799e-02, PNorm = 108.4198, GNorm = 0.4598, lr_0 = 9.2729e-04
Validation auc = 0.652143
Epoch 1463
Validation auc = 0.654603
Epoch 1464
Validation auc = 0.656188
Epoch 1465
Validation auc = 0.657118
Epoch 1466
Loss = 9.0619e-04, PNorm = 108.4746, GNorm = 0.0065, lr_0 = 9.2706e-04
Validation auc = 0.658211
Epoch 1467
Validation auc = 0.660125
Epoch 1468
Validation auc = 0.657227
Epoch 1469
Validation auc = 0.654603
Epoch 1470
Validation auc = 0.652690
Epoch 1471
Loss = 3.8629e-03, PNorm = 108.5135, GNorm = 0.3230, lr_0 = 9.2683e-04
Loss = 3.8696e-04, PNorm = 108.5172, GNorm = 0.0116, lr_0 = 9.2681e-04
Validation auc = 0.651487
Epoch 1472
Validation auc = 0.650612
Epoch 1473
Validation auc = 0.652471
Epoch 1474
Validation auc = 0.658703
Epoch 1475
Validation auc = 0.663459
Epoch 1476
Loss = 5.4167e-03, PNorm = 108.5644, GNorm = 0.2205, lr_0 = 9.2660e-04
Validation auc = 0.666794
Epoch 1477
Validation auc = 0.669200
Epoch 1478
Validation auc = 0.670020
Epoch 1479
Validation auc = 0.671496
Epoch 1480
Validation auc = 0.672480
Epoch 1481
Loss = 1.9047e-04, PNorm = 108.6114, GNorm = 0.0060, lr_0 = 9.2635e-04
Validation auc = 0.672042
Epoch 1482
Validation auc = 0.671988
Epoch 1483
Validation auc = 0.672152
Epoch 1484
Validation auc = 0.673026
Epoch 1485
Loss = 5.3643e-04, PNorm = 108.6365, GNorm = 0.0331, lr_0 = 9.2614e-04
Loss = 1.5275e-02, PNorm = 108.6397, GNorm = 1.8309, lr_0 = 9.2612e-04
Validation auc = 0.671605
Epoch 1486
Validation auc = 0.670020
Epoch 1487
Validation auc = 0.667997
Epoch 1488
Validation auc = 0.665209
Epoch 1489
Validation auc = 0.662967
Epoch 1490
Loss = 8.4809e-04, PNorm = 108.6900, GNorm = 0.0105, lr_0 = 9.2589e-04
Loss = 1.1095e-04, PNorm = 108.6941, GNorm = 0.0056, lr_0 = 9.2587e-04
Validation auc = 0.656407
Epoch 1491
Validation auc = 0.658211
Epoch 1492
Validation auc = 0.660562
Epoch 1493
Validation auc = 0.658539
Epoch 1494
Validation auc = 0.663186
Epoch 1495
Loss = 3.6099e-04, PNorm = 108.7428, GNorm = 0.0096, lr_0 = 9.2566e-04
Validation auc = 0.661437
Epoch 1496
Validation auc = 0.659742
Epoch 1497
Validation auc = 0.658485
Epoch 1498
Validation auc = 0.657883
Epoch 1499
Loss = 5.3923e-04, PNorm = 108.7855, GNorm = 0.0117, lr_0 = 9.2543e-04
Validation auc = 0.656681
Epoch 1500
Validation auc = 0.656462
Epoch 1501
Validation auc = 0.656954
Epoch 1502
Validation auc = 0.657227
Epoch 1503
Validation auc = 0.656735
Epoch 1504
Loss = 1.1730e-03, PNorm = 108.8086, GNorm = 0.0347, lr_0 = 9.2520e-04
Loss = 1.1815e-03, PNorm = 108.8102, GNorm = 0.0706, lr_0 = 9.2518e-04
Validation auc = 0.656188
Epoch 1505
Validation auc = 0.655478
Epoch 1506
Validation auc = 0.653892
Epoch 1507
Validation auc = 0.652854
Epoch 1508
Validation auc = 0.652416
Epoch 1509
Loss = 1.9246e-04, PNorm = 108.8308, GNorm = 0.0050, lr_0 = 9.2497e-04
Validation auc = 0.652252
Epoch 1510
Validation auc = 0.651760
Epoch 1511
Validation auc = 0.651651
Epoch 1512
Validation auc = 0.651378
Epoch 1513
Validation auc = 0.651651
Epoch 1514
Loss = 7.7236e-03, PNorm = 108.8433, GNorm = 0.5124, lr_0 = 9.2472e-04
Validation auc = 0.652799
Epoch 1515
Validation auc = 0.653346
Epoch 1516
Validation auc = 0.654275
Epoch 1517
Validation auc = 0.654603
Epoch 1518
Loss = 2.9035e-04, PNorm = 108.8513, GNorm = 0.0010, lr_0 = 9.2451e-04
Loss = 1.3729e-05, PNorm = 108.8518, GNorm = 0.0006, lr_0 = 9.2449e-04
Validation auc = 0.655532
Epoch 1519
Validation auc = 0.656353
Epoch 1520
Validation auc = 0.656517
Epoch 1521
Validation auc = 0.656462
Epoch 1522
Validation auc = 0.655368
Epoch 1523
Loss = 8.5352e-05, PNorm = 108.8646, GNorm = 0.0036, lr_0 = 9.2427e-04
Loss = 1.4991e-04, PNorm = 108.8661, GNorm = 0.0057, lr_0 = 9.2425e-04
Validation auc = 0.654876
Epoch 1524
Validation auc = 0.654986
Epoch 1525
Validation auc = 0.655040
Epoch 1526
Validation auc = 0.654986
Epoch 1527
Validation auc = 0.657938
Epoch 1528
Loss = 8.7596e-03, PNorm = 108.8707, GNorm = 0.6140, lr_0 = 9.2404e-04
Validation auc = 0.660234
Epoch 1529
Validation auc = 0.662803
Epoch 1530
Validation auc = 0.663678
Epoch 1531
Validation auc = 0.665920
Epoch 1532
Validation auc = 0.667068
Epoch 1533
Loss = 2.2303e-03, PNorm = 108.8800, GNorm = 0.2164, lr_0 = 9.2379e-04
Validation auc = 0.667942
Epoch 1534
Validation auc = 0.668981
Epoch 1535
Validation auc = 0.669801
Epoch 1536
Validation auc = 0.670348
Epoch 1537
Loss = 2.4290e-03, PNorm = 108.8942, GNorm = 0.0272, lr_0 = 9.2358e-04
Loss = 3.9177e-05, PNorm = 108.8952, GNorm = 0.0018, lr_0 = 9.2356e-04
Validation auc = 0.670402
Epoch 1538
Validation auc = 0.670621
Epoch 1539
Validation auc = 0.671277
Epoch 1540
Validation auc = 0.671550
Epoch 1541
Validation auc = 0.671824
Epoch 1542
Loss = 3.0253e-04, PNorm = 108.9061, GNorm = 0.0057, lr_0 = 9.2335e-04
Validation auc = 0.671714
Epoch 1543
Validation auc = 0.671878
Epoch 1544
Validation auc = 0.671769
Epoch 1545
Validation auc = 0.671714
Epoch 1546
Validation auc = 0.670676
Epoch 1547
Loss = 3.2667e-04, PNorm = 108.9214, GNorm = 0.0071, lr_0 = 9.2310e-04
Validation auc = 0.670676
Epoch 1548
Validation auc = 0.670840
Epoch 1549
Validation auc = 0.670566
Epoch 1550
Validation auc = 0.670566
Epoch 1551
Loss = 1.5637e-03, PNorm = 108.9326, GNorm = 0.0116, lr_0 = 9.2289e-04
Loss = 1.8813e-04, PNorm = 108.9331, GNorm = 0.0049, lr_0 = 9.2287e-04
Validation auc = 0.670840
Epoch 1552
Validation auc = 0.670566
Epoch 1553
Validation auc = 0.670402
Epoch 1554
Validation auc = 0.670402
Epoch 1555
Validation auc = 0.670293
Epoch 1556
Loss = 1.1469e-04, PNorm = 108.9420, GNorm = 0.0027, lr_0 = 9.2264e-04
Loss = 1.2908e-03, PNorm = 108.9425, GNorm = 0.0325, lr_0 = 9.2263e-04
Validation auc = 0.670238
Epoch 1557
Validation auc = 0.670238
Epoch 1558
Validation auc = 0.670293
Epoch 1559
Validation auc = 0.670457
Epoch 1560
Validation auc = 0.668489
Epoch 1561
Loss = 1.6294e-03, PNorm = 108.9452, GNorm = 0.1027, lr_0 = 9.2242e-04
Validation auc = 0.666412
Epoch 1562
Validation auc = 0.665592
Epoch 1563
Validation auc = 0.668762
Epoch 1564
Validation auc = 0.670785
Epoch 1565
Validation auc = 0.672917
Epoch 1566
Loss = 2.9453e-04, PNorm = 108.9463, GNorm = 0.0059, lr_0 = 9.2217e-04
Validation auc = 0.674339
Epoch 1567
Validation auc = 0.675432
Epoch 1568
Validation auc = 0.675924
Epoch 1569
Validation auc = 0.675159
Epoch 1570
Loss = 6.1256e-04, PNorm = 108.9565, GNorm = 0.0059, lr_0 = 9.2196e-04
Loss = 5.0968e-04, PNorm = 108.9575, GNorm = 0.0120, lr_0 = 9.2194e-04
Validation auc = 0.674612
Epoch 1571
Validation auc = 0.674667
Epoch 1572
Validation auc = 0.674940
Epoch 1573
Validation auc = 0.676033
Epoch 1574
Validation auc = 0.676416
Epoch 1575
Loss = 6.1821e-04, PNorm = 108.9707, GNorm = 0.0114, lr_0 = 9.2173e-04
Validation auc = 0.676744
Epoch 1576
Validation auc = 0.676689
Epoch 1577
Validation auc = 0.677291
Epoch 1578
Validation auc = 0.677892
Epoch 1579
Validation auc = 0.678111
Epoch 1580
Loss = 6.8842e-04, PNorm = 108.9809, GNorm = 0.0193, lr_0 = 9.2148e-04
Validation auc = 0.678439
Epoch 1581
Validation auc = 0.678548
Epoch 1582
Validation auc = 0.678767
Epoch 1583
Validation auc = 0.679204
Epoch 1584
Loss = 1.2769e-04, PNorm = 108.9884, GNorm = 0.0025, lr_0 = 9.2127e-04
Loss = 1.6868e-05, PNorm = 108.9888, GNorm = 0.0007, lr_0 = 9.2125e-04
Validation auc = 0.679477
Epoch 1585
Validation auc = 0.679477
Epoch 1586
Validation auc = 0.679532
Epoch 1587
Validation auc = 0.680516
Epoch 1588
Validation auc = 0.681773
Epoch 1589
Loss = 1.6850e-04, PNorm = 109.0181, GNorm = 0.0029, lr_0 = 9.2103e-04
Loss = 9.1713e-05, PNorm = 109.0207, GNorm = 0.0043, lr_0 = 9.2101e-04
Validation auc = 0.682101
Epoch 1590
Validation auc = 0.682812
Epoch 1591
Validation auc = 0.682976
Epoch 1592
Validation auc = 0.683632
Epoch 1593
Validation auc = 0.683960
Epoch 1594
Loss = 8.4056e-05, PNorm = 109.0470, GNorm = 0.0034, lr_0 = 9.2080e-04
Validation auc = 0.684452
Epoch 1595
Validation auc = 0.684726
Epoch 1596
Validation auc = 0.684999
Epoch 1597
Validation auc = 0.684726
Epoch 1598
Validation auc = 0.684616
Epoch 1599
Loss = 1.4387e-05, PNorm = 109.0620, GNorm = 0.0006, lr_0 = 9.2055e-04
Validation auc = 0.684562
Epoch 1600
Validation auc = 0.684671
Epoch 1601
Validation auc = 0.684671
Epoch 1602
Validation auc = 0.684616
Epoch 1603
Loss = 2.3213e-04, PNorm = 109.0681, GNorm = 0.0018, lr_0 = 9.2034e-04
Loss = 5.8015e-06, PNorm = 109.0683, GNorm = 0.0002, lr_0 = 9.2032e-04
Validation auc = 0.684780
Epoch 1604
Validation auc = 0.684780
Epoch 1605
Validation auc = 0.678357
Epoch 1606
Validation auc = 0.678439
Epoch 1607
Validation auc = 0.678548
Epoch 1608
Loss = 2.1885e-05, PNorm = 109.0724, GNorm = 0.0007, lr_0 = 9.2010e-04
Validation auc = 0.678739
Epoch 1609
Validation auc = 0.679013
Epoch 1610
Validation auc = 0.678958
Epoch 1611
Validation auc = 0.679095
Epoch 1612
Validation auc = 0.678985
Epoch 1613
Loss = 1.1263e-04, PNorm = 109.0753, GNorm = 0.0065, lr_0 = 9.1987e-04
Validation auc = 0.679095
Epoch 1614
Validation auc = 0.679040
Epoch 1615
Validation auc = 0.679013
Epoch 1616
Validation auc = 0.679067
Epoch 1617
Loss = 2.8687e-05, PNorm = 109.0777, GNorm = 0.0001, lr_0 = 9.1966e-04
Loss = 1.0331e-06, PNorm = 109.0779, GNorm = 0.0001, lr_0 = 9.1964e-04
Validation auc = 0.679122
Epoch 1618
Validation auc = 0.679259
Epoch 1619
Validation auc = 0.679149
Epoch 1620
Validation auc = 0.679122
Epoch 1621
Validation auc = 0.679341
Epoch 1622
Loss = 2.0381e-05, PNorm = 109.0806, GNorm = 0.0006, lr_0 = 9.1941e-04
Loss = 2.7581e-04, PNorm = 109.0809, GNorm = 0.0092, lr_0 = 9.1939e-04
Validation auc = 0.679395
Epoch 1623
Validation auc = 0.679231
Epoch 1624
Validation auc = 0.679313
Epoch 1625
Validation auc = 0.679204
Epoch 1626
Validation auc = 0.679204
Epoch 1627
Loss = 6.6492e-06, PNorm = 109.0848, GNorm = 0.0002, lr_0 = 9.1918e-04
Validation auc = 0.679177
Epoch 1628
Validation auc = 0.679149
Epoch 1629
Validation auc = 0.679149
Epoch 1630
Validation auc = 0.678985
Epoch 1631
Validation auc = 0.676689
Epoch 1632
Loss = 8.8968e-06, PNorm = 109.0879, GNorm = 0.0003, lr_0 = 9.1894e-04
Validation auc = 0.675022
Epoch 1633
Validation auc = 0.674311
Epoch 1634
Validation auc = 0.673819
Epoch 1635
Validation auc = 0.672480
Epoch 1636
Loss = 5.2820e-06, PNorm = 109.0968, GNorm = 0.0003, lr_0 = 9.1873e-04
Loss = 3.1789e-06, PNorm = 109.0987, GNorm = 0.0002, lr_0 = 9.1871e-04
Validation auc = 0.678111
Epoch 1637
Validation auc = 0.679532
Epoch 1638
Validation auc = 0.680516
Epoch 1639
Validation auc = 0.680899
Epoch 1640
Validation auc = 0.680625
Epoch 1641
Loss = 1.0396e-02, PNorm = 109.1255, GNorm = 3.3526, lr_0 = 9.1848e-04
Validation auc = 0.678165
Epoch 1642
Validation auc = 0.657938
Epoch 1643
Validation auc = 0.662311
Epoch 1644
Validation auc = 0.670074
Epoch 1645
Validation auc = 0.657993
Epoch 1646
Loss = 1.2469e-06, PNorm = 109.2418, GNorm = 0.0000, lr_0 = 9.1825e-04
Validation auc = 0.639897
Epoch 1647
Validation auc = 0.639515
Epoch 1648
Validation auc = 0.647770
Epoch 1649
Validation auc = 0.664170
Epoch 1650
Loss = 6.4047e-03, PNorm = 109.5192, GNorm = 1.2121, lr_0 = 9.1804e-04
Loss = 1.9191e-01, PNorm = 109.5524, GNorm = 15.0408, lr_0 = 9.1803e-04
Validation auc = 0.731030
Epoch 1651
Validation auc = 0.749891
Epoch 1652
Validation auc = 0.767494
Epoch 1653
Validation auc = 0.795047
Epoch 1654
Validation auc = 0.814290
Epoch 1655
Loss = 1.3790e-01, PNorm = 110.1251, GNorm = 1.6951, lr_0 = 9.1780e-04
Loss = 1.3121e-01, PNorm = 110.1661, GNorm = 3.7464, lr_0 = 9.1778e-04
Validation auc = 0.837197
Epoch 1656
Validation auc = 0.835611
Epoch 1657
Validation auc = 0.825279
Epoch 1658
Validation auc = 0.811010
Epoch 1659
Validation auc = 0.783075
Epoch 1660
Loss = 3.5989e-02, PNorm = 110.6466, GNorm = 0.9090, lr_0 = 9.1757e-04
Validation auc = 0.765362
Epoch 1661
Validation auc = 0.751695
Epoch 1662
Validation auc = 0.756779
Epoch 1663
Validation auc = 0.766565
Epoch 1664
Validation auc = 0.776296
Epoch 1665
Loss = 1.6699e-02, PNorm = 111.0816, GNorm = 0.3457, lr_0 = 9.1733e-04
Validation auc = 0.781927
Epoch 1666
Validation auc = 0.783457
Epoch 1667
Validation auc = 0.784113
Epoch 1668
Validation auc = 0.786191
Epoch 1669
Loss = 1.0218e-02, PNorm = 111.2734, GNorm = 0.2056, lr_0 = 9.1712e-04
Loss = 2.3272e-03, PNorm = 111.2841, GNorm = 0.1207, lr_0 = 9.1710e-04
Validation auc = 0.786901
Epoch 1670
Validation auc = 0.787776
Epoch 1671
Validation auc = 0.781872
Epoch 1672
Validation auc = 0.773125
Epoch 1673
Validation auc = 0.766182
Epoch 1674
Loss = 1.1493e-01, PNorm = 111.4257, GNorm = 2.7307, lr_0 = 9.1687e-04
Validation auc = 0.772469
Epoch 1675
Validation auc = 0.777006
Epoch 1676
Validation auc = 0.785097
Epoch 1677
Validation auc = 0.792696
Epoch 1678
Validation auc = 0.787721
Epoch 1679
Loss = 1.8671e-02, PNorm = 111.7076, GNorm = 0.4572, lr_0 = 9.1664e-04
Validation auc = 0.760660
Epoch 1680
Validation auc = 0.732615
Epoch 1681
Validation auc = 0.672480
Epoch 1682
Validation auc = 0.665974
Epoch 1683
Loss = 2.5254e-02, PNorm = 112.1366, GNorm = 0.0729, lr_0 = 9.1642e-04
Validation auc = 0.671714
Epoch 1684
Validation auc = 0.704570
Epoch 1685
Validation auc = 0.722556
Epoch 1686
Validation auc = 0.731085
Epoch 1687
Validation auc = 0.735403
Epoch 1688
Loss = 2.0002e-02, PNorm = 112.4360, GNorm = 0.1806, lr_0 = 9.1619e-04
Loss = 2.9779e-03, PNorm = 112.4553, GNorm = 0.2031, lr_0 = 9.1617e-04
Validation auc = 0.734037
Epoch 1689
Validation auc = 0.732069
Epoch 1690
Validation auc = 0.727914
Epoch 1691
Validation auc = 0.727476
Epoch 1692
Validation auc = 0.725836
Epoch 1693
Loss = 4.8569e-03, PNorm = 112.6318, GNorm = 0.1079, lr_0 = 9.1596e-04
Validation auc = 0.719550
Epoch 1694
Validation auc = 0.723704
Epoch 1695
Validation auc = 0.729171
Epoch 1696
Validation auc = 0.712497
Epoch 1697
Validation auc = 0.695495
Epoch 1698
Loss = 9.7365e-03, PNorm = 112.8152, GNorm = 0.4827, lr_0 = 9.1572e-04
Validation auc = 0.690466
Epoch 1699
Validation auc = 0.686038
Epoch 1700
Validation auc = 0.683742
Epoch 1701
Validation auc = 0.680243
Epoch 1702
Loss = 3.7149e-02, PNorm = 112.9757, GNorm = 0.4279, lr_0 = 9.1551e-04
Loss = 2.3995e-01, PNorm = 112.9852, GNorm = 5.3106, lr_0 = 9.1549e-04
Validation auc = 0.679313
Epoch 1703
Validation auc = 0.681445
Epoch 1704
Validation auc = 0.686694
Epoch 1705
Validation auc = 0.691176
Epoch 1706
Validation auc = 0.692871
Epoch 1707
Loss = 2.9091e-03, PNorm = 113.1342, GNorm = 0.1447, lr_0 = 9.1526e-04
Loss = 8.6267e-04, PNorm = 113.1425, GNorm = 0.0603, lr_0 = 9.1525e-04
Validation auc = 0.694238
Epoch 1708
Validation auc = 0.693418
Epoch 1709
Validation auc = 0.687295
Epoch 1710
Validation auc = 0.674175
Epoch 1711
Validation auc = 0.672835
Epoch 1712
Loss = 2.7555e-03, PNorm = 113.2438, GNorm = 0.0942, lr_0 = 9.1504e-04
Validation auc = 0.673136
Epoch 1713
Validation auc = 0.677263
Epoch 1714
Validation auc = 0.680844
Epoch 1715
Validation auc = 0.682539
Epoch 1716
Loss = 3.6214e-03, PNorm = 113.3286, GNorm = 0.0029, lr_0 = 9.1481e-04
Validation auc = 0.684562
Epoch 1717
Validation auc = 0.684398
Epoch 1718
Validation auc = 0.684835
Epoch 1719
Validation auc = 0.683632
Epoch 1720
Validation auc = 0.678001
Epoch 1721
Loss = 2.1394e-02, PNorm = 113.4102, GNorm = 0.0253, lr_0 = 9.1458e-04
Loss = 6.9145e-04, PNorm = 113.4174, GNorm = 0.0340, lr_0 = 9.1457e-04
Validation auc = 0.671277
Epoch 1722
Validation auc = 0.667505
Epoch 1723
Validation auc = 0.666248
Epoch 1724
Validation auc = 0.668489
Epoch 1725
Validation auc = 0.669910
Epoch 1726
Loss = 4.4472e-02, PNorm = 113.5023, GNorm = 1.2710, lr_0 = 9.1436e-04
Validation auc = 0.702056
Epoch 1727
Validation auc = 0.722502
Epoch 1728
Validation auc = 0.731850
Epoch 1729
Validation auc = 0.735786
Epoch 1730
Validation auc = 0.735021
Epoch 1731
Loss = 2.4403e-04, PNorm = 113.6069, GNorm = 0.0136, lr_0 = 9.1411e-04
Validation auc = 0.732069
Epoch 1732
Validation auc = 0.713700
Epoch 1733
Validation auc = 0.697409
Epoch 1734
Validation auc = 0.694019
Epoch 1735
Loss = 6.3265e-02, PNorm = 113.7602, GNorm = 1.3154, lr_0 = 9.1390e-04
Loss = 1.9104e-02, PNorm = 113.7762, GNorm = 0.2859, lr_0 = 9.1389e-04
Validation auc = 0.702220
Epoch 1736
Validation auc = 0.710147
Epoch 1737
Validation auc = 0.716707
Epoch 1738
Validation auc = 0.720042
Epoch 1739
Validation auc = 0.721682
Epoch 1740
Loss = 1.1766e-01, PNorm = 113.9620, GNorm = 0.1202, lr_0 = 9.1366e-04
Loss = 8.5205e-03, PNorm = 113.9722, GNorm = 0.1580, lr_0 = 9.1364e-04
Validation auc = 0.726930
Epoch 1741
Validation auc = 0.731959
Epoch 1742
Validation auc = 0.734857
Epoch 1743
Validation auc = 0.738848
Epoch 1744
Validation auc = 0.742456
Epoch 1745
Loss = 4.7039e-03, PNorm = 114.0954, GNorm = 0.0620, lr_0 = 9.1343e-04
Validation auc = 0.747813
Epoch 1746
Validation auc = 0.753717
Epoch 1747
Validation auc = 0.750383
Epoch 1748
Validation auc = 0.749836
Epoch 1749
Loss = 1.9259e-03, PNorm = 114.1603, GNorm = 0.0297, lr_0 = 9.1320e-04
Validation auc = 0.748305
Epoch 1750
Validation auc = 0.749016
Epoch 1751
Validation auc = 0.750328
Epoch 1752
Validation auc = 0.751093
Epoch 1753
Validation auc = 0.751968
Epoch 1754
Loss = 6.3093e-02, PNorm = 114.1915, GNorm = 0.5584, lr_0 = 9.1298e-04
Loss = 2.2238e-03, PNorm = 114.1948, GNorm = 0.1259, lr_0 = 9.1296e-04
Validation auc = 0.748852
Epoch 1755
Validation auc = 0.743549
Epoch 1756
Validation auc = 0.739176
Epoch 1757
Validation auc = 0.732889
Epoch 1758
Validation auc = 0.736880
Epoch 1759
Loss = 2.3909e-02, PNorm = 114.2817, GNorm = 1.4976, lr_0 = 9.1275e-04
Validation auc = 0.731358
Epoch 1760
Validation auc = 0.721190
Epoch 1761
Validation auc = 0.709983
Epoch 1762
Validation auc = 0.707850
Epoch 1763
Validation auc = 0.708288
Epoch 1764
Loss = 1.0757e-02, PNorm = 114.4145, GNorm = 0.2702, lr_0 = 9.1251e-04
Validation auc = 0.708616
Epoch 1765
Validation auc = 0.710584
Epoch 1766
Validation auc = 0.709326
Epoch 1767
Validation auc = 0.706374
Epoch 1768
Loss = 1.3415e-03, PNorm = 114.4948, GNorm = 0.0334, lr_0 = 9.1230e-04
Loss = 8.4176e-04, PNorm = 114.4990, GNorm = 0.0204, lr_0 = 9.1228e-04
Validation auc = 0.702876
Epoch 1769
Validation auc = 0.701400
Epoch 1770
Validation auc = 0.700634
Epoch 1771
Validation auc = 0.702056
Epoch 1772
Validation auc = 0.696971
Epoch 1773
Loss = 3.8702e-04, PNorm = 114.5505, GNorm = 0.0070, lr_0 = 9.1206e-04
Loss = 1.5127e-04, PNorm = 114.5539, GNorm = 0.0044, lr_0 = 9.1204e-04
Validation auc = 0.693582
Epoch 1774
Validation auc = 0.691832
Epoch 1775
Validation auc = 0.695277
Epoch 1776
Validation auc = 0.704352
Epoch 1777
Validation auc = 0.711185
Epoch 1778
Loss = 4.2803e-04, PNorm = 114.6008, GNorm = 0.0114, lr_0 = 9.1183e-04
Validation auc = 0.712279
Epoch 1779
Validation auc = 0.704789
Epoch 1780
Validation auc = 0.695878
Epoch 1781
Validation auc = 0.691832
Epoch 1782
Validation auc = 0.690575
Epoch 1783
Loss = 4.3005e-04, PNorm = 114.7045, GNorm = 0.0207, lr_0 = 9.1159e-04
Validation auc = 0.685382
Epoch 1784
Validation auc = 0.678111
Epoch 1785
Validation auc = 0.675705
Epoch 1786
Validation auc = 0.673245
Epoch 1787
Loss = 4.4942e-03, PNorm = 114.8002, GNorm = 0.1566, lr_0 = 9.1138e-04
Loss = 2.0562e-03, PNorm = 114.8072, GNorm = 0.0851, lr_0 = 9.1136e-04
Validation auc = 0.673573
Epoch 1788
Validation auc = 0.681063
Epoch 1789
Validation auc = 0.688662
Epoch 1790
Validation auc = 0.698557
Epoch 1791
Validation auc = 0.709545
Epoch 1792
Loss = 1.4896e-03, PNorm = 114.8768, GNorm = 0.0338, lr_0 = 9.1115e-04
Validation auc = 0.715067
Epoch 1793
Validation auc = 0.721026
Epoch 1794
Validation auc = 0.724524
Epoch 1795
Validation auc = 0.727586
Epoch 1796
Validation auc = 0.728843
Epoch 1797
Loss = 9.4085e-04, PNorm = 114.9311, GNorm = 0.0187, lr_0 = 9.1091e-04
Validation auc = 0.729663
Epoch 1798
Validation auc = 0.730374
Epoch 1799
Validation auc = 0.731139
Epoch 1800
Validation auc = 0.731249
Epoch 1801
Loss = 1.7776e-03, PNorm = 114.9539, GNorm = 0.0033, lr_0 = 9.1070e-04
Loss = 4.4537e-04, PNorm = 114.9549, GNorm = 0.0149, lr_0 = 9.1068e-04
Validation auc = 0.731085
Epoch 1802
Validation auc = 0.730975
Epoch 1803
Validation auc = 0.730975
Epoch 1804
Validation auc = 0.730702
Epoch 1805
Validation auc = 0.730265
Epoch 1806
Loss = 6.9810e-04, PNorm = 114.9708, GNorm = 0.0182, lr_0 = 9.1046e-04
Loss = 9.5763e-06, PNorm = 114.9721, GNorm = 0.0006, lr_0 = 9.1044e-04
Validation auc = 0.730538
Epoch 1807
Validation auc = 0.730866
Epoch 1808
Validation auc = 0.730593
Epoch 1809
Validation auc = 0.730265
Epoch 1810
Validation auc = 0.730210
Epoch 1811
Loss = 6.4583e-04, PNorm = 114.9902, GNorm = 0.0179, lr_0 = 9.1023e-04
Validation auc = 0.729882
Epoch 1812
Validation auc = 0.729226
Epoch 1813
Validation auc = 0.728953
Epoch 1814
Validation auc = 0.728078
Epoch 1815
Validation auc = 0.728461
Epoch 1816
Loss = 2.0541e-04, PNorm = 115.0064, GNorm = 0.0066, lr_0 = 9.0999e-04
Validation auc = 0.727969
Epoch 1817
Validation auc = 0.743002
Epoch 1818
Validation auc = 0.749563
Epoch 1819
Validation auc = 0.753007
Epoch 1820
Loss = 4.4878e-02, PNorm = 115.0818, GNorm = 0.9294, lr_0 = 9.0978e-04
Loss = 8.5196e-04, PNorm = 115.0915, GNorm = 0.0244, lr_0 = 9.0976e-04
Validation auc = 0.751531
Epoch 1821
Validation auc = 0.754319
Epoch 1822
Validation auc = 0.759348
Epoch 1823
Validation auc = 0.763066
Epoch 1824
Validation auc = 0.763667
Epoch 1825
Loss = 5.2997e-03, PNorm = 115.2013, GNorm = 0.0855, lr_0 = 9.0955e-04
Validation auc = 0.763175
Epoch 1826
Validation auc = 0.761918
Epoch 1827
Validation auc = 0.758802
Epoch 1828
Validation auc = 0.756396
Epoch 1829
Validation auc = 0.752515
Epoch 1830
Loss = 1.7070e-03, PNorm = 115.2893, GNorm = 0.0343, lr_0 = 9.0931e-04
Validation auc = 0.752351
Epoch 1831
Validation auc = 0.751859
Epoch 1832
Validation auc = 0.751312
Epoch 1833
Validation auc = 0.755904
Epoch 1834
Loss = 1.9447e-03, PNorm = 115.3372, GNorm = 0.0184, lr_0 = 9.0910e-04
Loss = 1.6271e-05, PNorm = 115.3406, GNorm = 0.0007, lr_0 = 9.0909e-04
Validation auc = 0.756506
Epoch 1835
Validation auc = 0.756287
Epoch 1836
Validation auc = 0.755686
Epoch 1837
Validation auc = 0.754592
Epoch 1838
Validation auc = 0.753389
Epoch 1839
Loss = 2.5508e-04, PNorm = 115.3702, GNorm = 0.0332, lr_0 = 9.0886e-04
Loss = 2.5828e-04, PNorm = 115.3715, GNorm = 0.0161, lr_0 = 9.0884e-04
Validation auc = 0.751531
Epoch 1840
Validation auc = 0.748961
Epoch 1841
Validation auc = 0.746720
Epoch 1842
Validation auc = 0.740652
Epoch 1843
Validation auc = 0.741472
Epoch 1844
Loss = 3.3118e-02, PNorm = 115.3972, GNorm = 0.5492, lr_0 = 9.0863e-04
Validation auc = 0.745134
Epoch 1845
Validation auc = 0.751859
Epoch 1846
Validation auc = 0.758747
Epoch 1847
Validation auc = 0.758692
Epoch 1848
Validation auc = 0.753553
Epoch 1849
Loss = 7.5930e-03, PNorm = 115.5686, GNorm = 0.0946, lr_0 = 9.0839e-04
Validation auc = 0.744369
Epoch 1850
Validation auc = 0.729718
Epoch 1851
Validation auc = 0.718620
Epoch 1852
Validation auc = 0.708178
Epoch 1853
Loss = 2.1614e-03, PNorm = 115.6712, GNorm = 0.0224, lr_0 = 9.0818e-04
Loss = 2.5038e-03, PNorm = 115.6772, GNorm = 0.0555, lr_0 = 9.0817e-04
Validation auc = 0.700689
Epoch 1854
Validation auc = 0.694511
Epoch 1855
Validation auc = 0.687022
Epoch 1856
Validation auc = 0.682484
Epoch 1857
Validation auc = 0.680571
Epoch 1858
Loss = 3.2175e-04, PNorm = 115.7395, GNorm = 0.0080, lr_0 = 9.0794e-04
Validation auc = 0.678439
Epoch 1859
Validation auc = 0.677400
Epoch 1860
Validation auc = 0.679423
Epoch 1861
Validation auc = 0.680079
Epoch 1862
Validation auc = 0.680516
Epoch 1863
Loss = 2.4351e-03, PNorm = 115.7707, GNorm = 0.1157, lr_0 = 9.0772e-04
Validation auc = 0.681500
Epoch 1864
Validation auc = 0.682593
Epoch 1865
Validation auc = 0.683960
Epoch 1866
Validation auc = 0.685874
Epoch 1867
Loss = 1.2932e-04, PNorm = 115.7914, GNorm = 0.0021, lr_0 = 9.0751e-04
Loss = 9.7808e-05, PNorm = 115.7926, GNorm = 0.0054, lr_0 = 9.0749e-04
Validation auc = 0.688388
Epoch 1868
Validation auc = 0.690302
Epoch 1869
Validation auc = 0.691286
Epoch 1870
Validation auc = 0.691942
Epoch 1871
Validation auc = 0.692489
Epoch 1872
Loss = 2.4105e-03, PNorm = 115.8069, GNorm = 0.9039, lr_0 = 9.0727e-04
Loss = 2.0960e-05, PNorm = 115.8081, GNorm = 0.0013, lr_0 = 9.0725e-04
Validation auc = 0.687295
Epoch 1873
Validation auc = 0.679696
Epoch 1874
Validation auc = 0.673354
Epoch 1875
Validation auc = 0.668544
Epoch 1876
Validation auc = 0.684726
Epoch 1877
Loss = 1.6827e-04, PNorm = 115.8274, GNorm = 0.0166, lr_0 = 9.0704e-04
Validation auc = 0.693637
Epoch 1878
Validation auc = 0.698174
Epoch 1879
Validation auc = 0.702493
Epoch 1880
Validation auc = 0.705062
Epoch 1881
Validation auc = 0.706593
Epoch 1882
Loss = 4.1539e-05, PNorm = 115.8488, GNorm = 0.0027, lr_0 = 9.0680e-04
Validation auc = 0.707905
Epoch 1883
Validation auc = 0.708725
Epoch 1884
Validation auc = 0.708944
Epoch 1885
Validation auc = 0.709217
Epoch 1886
Loss = 2.8283e-02, PNorm = 115.8591, GNorm = 3.1488, lr_0 = 9.0659e-04
Loss = 7.0531e-06, PNorm = 115.8601, GNorm = 0.0003, lr_0 = 9.0657e-04
Validation auc = 0.706046
Epoch 1887
Validation auc = 0.703969
Epoch 1888
Validation auc = 0.702274
Epoch 1889
Validation auc = 0.708998
Epoch 1890
Validation auc = 0.712716
Epoch 1891
Loss = 7.1007e-04, PNorm = 115.8695, GNorm = 0.0091, lr_0 = 9.0635e-04
Validation auc = 0.715777
Epoch 1892
Validation auc = 0.718511
Epoch 1893
Validation auc = 0.720698
Epoch 1894
Validation auc = 0.721682
Epoch 1895
Validation auc = 0.722174
Epoch 1896
Loss = 5.6050e-04, PNorm = 115.8879, GNorm = 0.0185, lr_0 = 9.0612e-04
Validation auc = 0.722666
Epoch 1897
Validation auc = 0.723048
Epoch 1898
Validation auc = 0.723048
Epoch 1899
Validation auc = 0.722392
Epoch 1900
Loss = 3.9128e-02, PNorm = 115.9054, GNorm = 0.6168, lr_0 = 9.0592e-04
Loss = 2.0182e-04, PNorm = 115.9059, GNorm = 0.0057, lr_0 = 9.0590e-04
Validation auc = 0.721463
Epoch 1901
Validation auc = 0.720643
Epoch 1902
Validation auc = 0.720752
Epoch 1903
Validation auc = 0.720698
Epoch 1904
Validation auc = 0.720698
Epoch 1905
Loss = 3.0125e-04, PNorm = 115.9215, GNorm = 0.0081, lr_0 = 9.0567e-04
Loss = 4.0029e-04, PNorm = 115.9227, GNorm = 0.0217, lr_0 = 9.0566e-04
Validation auc = 0.720424
Epoch 1906
Validation auc = 0.719932
Epoch 1907
Validation auc = 0.719714
Epoch 1908
Validation auc = 0.719386
Epoch 1909
Validation auc = 0.719495
Epoch 1910
Loss = 1.0741e-03, PNorm = 115.9414, GNorm = 0.0319, lr_0 = 9.0545e-04
Validation auc = 0.718839
Epoch 1911
Validation auc = 0.718620
Epoch 1912
Validation auc = 0.718347
Epoch 1913
Validation auc = 0.719823
Epoch 1914
Validation auc = 0.720479
Epoch 1915
Loss = 4.0087e-04, PNorm = 115.9559, GNorm = 0.0214, lr_0 = 9.0521e-04
Validation auc = 0.719932
Epoch 1916
Validation auc = 0.720588
Epoch 1917
Validation auc = 0.719550
Epoch 1918
Validation auc = 0.718839
Epoch 1919
Loss = 1.7119e-04, PNorm = 115.9629, GNorm = 0.0014, lr_0 = 9.0500e-04
Loss = 1.2199e-05, PNorm = 115.9637, GNorm = 0.0005, lr_0 = 9.0498e-04
Validation auc = 0.718620
Epoch 1920
Validation auc = 0.717800
Epoch 1921
Validation auc = 0.716761
Epoch 1922
Validation auc = 0.709162
Epoch 1923
Validation auc = 0.695960
Epoch 1924
Loss = 1.4270e-03, PNorm = 115.9967, GNorm = 0.1315, lr_0 = 9.0476e-04
Validation auc = 0.692024
Epoch 1925
Validation auc = 0.724852
Epoch 1926
Validation auc = 0.742838
Epoch 1927
Validation auc = 0.740160
Epoch 1928
Validation auc = 0.734037
Epoch 1929
Loss = 3.0768e-02, PNorm = 116.0681, GNorm = 0.2754, lr_0 = 9.0454e-04
Validation auc = 0.730483
Epoch 1930
Validation auc = 0.725836
Epoch 1931
Validation auc = 0.724196
Epoch 1932
Validation auc = 0.722720
Epoch 1933
Loss = 4.8783e-03, PNorm = 116.1567, GNorm = 0.0466, lr_0 = 9.0431e-04
Validation auc = 0.721627
Epoch 1934
Validation auc = 0.719768
Epoch 1935
Validation auc = 0.718729
Epoch 1936
Validation auc = 0.719058
Epoch 1937
Validation auc = 0.719714
Epoch 1938
Loss = 3.4261e-02, PNorm = 116.2150, GNorm = 0.0132, lr_0 = 9.0409e-04
Loss = 2.3279e-01, PNorm = 116.2182, GNorm = 4.5329, lr_0 = 9.0407e-04
Validation auc = 0.717144
Epoch 1939
Validation auc = 0.697463
Epoch 1940
Validation auc = 0.690739
Epoch 1941
Validation auc = 0.696370
Epoch 1942
Validation auc = 0.703586
Epoch 1943
Loss = 1.8444e-03, PNorm = 116.2954, GNorm = 0.0360, lr_0 = 9.0386e-04
Validation auc = 0.708069
Epoch 1944
Validation auc = 0.711404
Epoch 1945
Validation auc = 0.713809
Epoch 1946
Validation auc = 0.715668
Epoch 1947
Validation auc = 0.716433
Epoch 1948
Loss = 1.3933e-04, PNorm = 116.3685, GNorm = 0.0033, lr_0 = 9.0362e-04
Validation auc = 0.716707
Epoch 1949
Validation auc = 0.716488
Epoch 1950
Validation auc = 0.716379
Epoch 1951
Validation auc = 0.714739
Epoch 1952
Loss = 5.1823e-04, PNorm = 116.4047, GNorm = 0.0128, lr_0 = 9.0341e-04
Loss = 9.8167e-05, PNorm = 116.4075, GNorm = 0.0074, lr_0 = 9.0340e-04
Validation auc = 0.712443
Epoch 1953
Validation auc = 0.711951
Epoch 1954
Validation auc = 0.710475
Epoch 1955
Validation auc = 0.709928
Epoch 1956
Validation auc = 0.709600
Epoch 1957
Loss = 4.4613e-04, PNorm = 116.4473, GNorm = 0.0124, lr_0 = 9.0317e-04
Loss = 1.2630e-04, PNorm = 116.4499, GNorm = 0.0063, lr_0 = 9.0316e-04
Validation auc = 0.709873
Epoch 1958
Validation auc = 0.710857
Epoch 1959
Validation auc = 0.710092
Epoch 1960
Validation auc = 0.709053
Epoch 1961
Validation auc = 0.708725
Epoch 1962
Loss = 5.3517e-05, PNorm = 116.4761, GNorm = 0.0025, lr_0 = 9.0295e-04
Validation auc = 0.708670
Epoch 1963
Validation auc = 0.707905
Epoch 1964
Validation auc = 0.707796
Epoch 1965
Validation auc = 0.707140
Epoch 1966
Loss = 1.3785e-04, PNorm = 116.4863, GNorm = 0.0001, lr_0 = 9.0273e-04
Validation auc = 0.705445
Epoch 1967
Validation auc = 0.705281
Epoch 1968
Validation auc = 0.704352
Epoch 1969
Validation auc = 0.703313
Epoch 1970
Validation auc = 0.703422
Epoch 1971
Loss = 2.7661e-04, PNorm = 116.4979, GNorm = 0.0031, lr_0 = 9.0250e-04
Loss = 1.4523e-05, PNorm = 116.4990, GNorm = 0.0010, lr_0 = 9.0249e-04
Validation auc = 0.702766
Epoch 1972
Validation auc = 0.702548
Epoch 1973
Validation auc = 0.702602
Epoch 1974
Validation auc = 0.702876
Epoch 1975
Validation auc = 0.702930
Epoch 1976
Loss = 3.3529e-04, PNorm = 116.5164, GNorm = 0.0167, lr_0 = 9.0228e-04
Validation auc = 0.703914
Epoch 1977
Validation auc = 0.705117
Epoch 1978
Validation auc = 0.706101
Epoch 1979
Validation auc = 0.706921
Epoch 1980
Validation auc = 0.706702
Epoch 1981
Loss = 4.4734e-04, PNorm = 116.5339, GNorm = 0.0270, lr_0 = 9.0204e-04
Validation auc = 0.705664
Epoch 1982
Validation auc = 0.703750
Epoch 1983
Validation auc = 0.702985
Epoch 1984
Validation auc = 0.703204
Epoch 1985
Loss = 3.9271e-04, PNorm = 116.5572, GNorm = 0.0143, lr_0 = 9.0183e-04
Loss = 1.4622e-05, PNorm = 116.5590, GNorm = 0.0012, lr_0 = 9.0181e-04
Validation auc = 0.702985
Epoch 1986
Validation auc = 0.704242
Epoch 1987
Validation auc = 0.704406
Epoch 1988
Validation auc = 0.702165
Epoch 1989
Validation auc = 0.702165
Epoch 1990
Loss = 3.3985e-06, PNorm = 116.6028, GNorm = 0.0002, lr_0 = 9.0159e-04
Loss = 4.2120e-06, PNorm = 116.6051, GNorm = 0.0002, lr_0 = 9.0157e-04
Validation auc = 0.702766
Epoch 1991
Validation auc = 0.702438
Epoch 1992
Validation auc = 0.702220
Epoch 1993
Validation auc = 0.702220
Epoch 1994
Validation auc = 0.702493
Epoch 1995
Loss = 3.3048e-05, PNorm = 116.6242, GNorm = 0.0055, lr_0 = 9.0137e-04
Validation auc = 0.702493
Epoch 1996
Validation auc = 0.702165
Epoch 1997
Validation auc = 0.702110
Epoch 1998
Validation auc = 0.701454
Epoch 1999
Loss = 9.2482e-03, PNorm = 116.6452, GNorm = 0.0014, lr_0 = 9.0114e-04
Validation auc = 0.696534
Model 0 best validation auc = 0.837197 on epoch 1655
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.701207
Ensemble test auc = 0.701207
Fold 7
Splitting data with seed 7
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.541220
Epoch 1
Validation auc = 0.473540
Epoch 2
Validation auc = 0.552755
Epoch 3
Validation auc = 0.672698
Epoch 4
Loss = 6.9763e-01, PNorm = 71.6150, GNorm = 1.3732, lr_0 = 2.0385e-04
Loss = 6.8268e-01, PNorm = 71.6163, GNorm = 2.6525, lr_0 = 2.1077e-04
Validation auc = 0.639351
Epoch 5
Validation auc = 0.681828
Epoch 6
Validation auc = 0.448338
Epoch 7
Validation auc = 0.701618
Epoch 8
Validation auc = 0.555817
Epoch 9
Loss = 7.0445e-01, PNorm = 71.6361, GNorm = 1.8477, lr_0 = 3.0077e-04
Validation auc = 0.648699
Epoch 10
Validation auc = 0.664662
Epoch 11
Validation auc = 0.658758
Epoch 12
Validation auc = 0.626503
Epoch 13
Validation auc = 0.638093
Epoch 14
Loss = 6.8246e-01, PNorm = 71.6725, GNorm = 0.5595, lr_0 = 4.0462e-04
Validation auc = 0.613930
Epoch 15
Validation auc = 0.651542
Epoch 16
Validation auc = 0.668817
Epoch 17
Validation auc = 0.629073
Epoch 18
Loss = 6.8256e-01, PNorm = 71.7200, GNorm = 0.5785, lr_0 = 4.9462e-04
Loss = 6.2637e-01, PNorm = 71.7247, GNorm = 1.0227, lr_0 = 5.0154e-04
Validation auc = 0.647606
Epoch 19
Validation auc = 0.640991
Epoch 20
Validation auc = 0.655587
Epoch 21
Validation auc = 0.683687
Epoch 22
Validation auc = 0.690739
Epoch 23
Loss = 6.8380e-01, PNorm = 71.8062, GNorm = 1.1286, lr_0 = 5.9846e-04
Loss = 5.9276e-01, PNorm = 71.8122, GNorm = 1.3418, lr_0 = 6.0538e-04
Validation auc = 0.658649
Epoch 24
Validation auc = 0.668762
Epoch 25
Validation auc = 0.665592
Epoch 26
Validation auc = 0.662366
Epoch 27
Validation auc = 0.636180
Epoch 28
Loss = 6.3393e-01, PNorm = 71.9069, GNorm = 0.3394, lr_0 = 6.9538e-04
Validation auc = 0.621474
Epoch 29
Validation auc = 0.660125
Epoch 30
Validation auc = 0.656079
Epoch 31
Validation auc = 0.663022
Epoch 32
Validation auc = 0.628198
Epoch 33
Loss = 6.8900e-01, PNorm = 72.0394, GNorm = 0.6274, lr_0 = 7.9923e-04
Validation auc = 0.627487
Epoch 34
Validation auc = 0.628963
Epoch 35
Validation auc = 0.629182
Epoch 36
Validation auc = 0.621091
Epoch 37
Loss = 6.1470e-01, PNorm = 72.1862, GNorm = 0.4714, lr_0 = 8.8923e-04
Loss = 5.1855e-01, PNorm = 72.1994, GNorm = 0.8764, lr_0 = 8.9615e-04
Validation auc = 0.622786
Epoch 38
Validation auc = 0.607369
Epoch 39
Validation auc = 0.604691
Epoch 40
Validation auc = 0.607643
Epoch 41
Validation auc = 0.627323
Epoch 42
Loss = 6.4611e-01, PNorm = 72.3870, GNorm = 0.8037, lr_0 = 9.8615e-04
Validation auc = 0.626995
Epoch 43
Validation auc = 0.605784
Epoch 44
Validation auc = 0.626831
Epoch 45
Validation auc = 0.630768
Epoch 46
Validation auc = 0.613820
Epoch 47
Loss = 6.1648e-01, PNorm = 72.6183, GNorm = 0.2759, lr_0 = 9.9977e-04
Validation auc = 0.608627
Epoch 48
Validation auc = 0.606495
Epoch 49
Validation auc = 0.598677
Epoch 50
Validation auc = 0.601028
Epoch 51
Loss = 5.8852e-01, PNorm = 72.8276, GNorm = 0.3709, lr_0 = 9.9954e-04
Loss = 6.0144e-01, PNorm = 72.8403, GNorm = 1.5742, lr_0 = 9.9952e-04
Validation auc = 0.601793
Epoch 52
Validation auc = 0.582167
Epoch 53
Validation auc = 0.562432
Epoch 54
Validation auc = 0.608189
Epoch 55
Validation auc = 0.590313
Epoch 56
Loss = 6.0803e-01, PNorm = 73.1113, GNorm = 0.7638, lr_0 = 9.9927e-04
Loss = 5.7940e-01, PNorm = 73.1340, GNorm = 1.3615, lr_0 = 9.9926e-04
Validation auc = 0.593976
Epoch 57
Validation auc = 0.617374
Epoch 58
Validation auc = 0.614586
Epoch 59
Validation auc = 0.601082
Epoch 60
Validation auc = 0.609119
Epoch 61
Loss = 5.8954e-01, PNorm = 73.4425, GNorm = 0.5053, lr_0 = 9.9903e-04
Validation auc = 0.619779
Epoch 62
Validation auc = 0.616991
Epoch 63
Validation auc = 0.610431
Epoch 64
Validation auc = 0.608463
Epoch 65
Validation auc = 0.579106
Epoch 66
Loss = 4.3413e-01, PNorm = 73.7766, GNorm = 0.7628, lr_0 = 9.9876e-04
Validation auc = 0.562814
Epoch 67
Validation auc = 0.585502
Epoch 68
Validation auc = 0.606385
Epoch 69
Validation auc = 0.600536
Epoch 70
Loss = 6.1289e-01, PNorm = 74.0583, GNorm = 2.9358, lr_0 = 9.9853e-04
Loss = 4.6072e-01, PNorm = 74.0825, GNorm = 2.1459, lr_0 = 9.9851e-04
Validation auc = 0.660835
Epoch 71
Validation auc = 0.651596
Epoch 72
Validation auc = 0.648754
Epoch 73
Validation auc = 0.646348
Epoch 74
Validation auc = 0.618303
Epoch 75
Loss = 4.4548e-01, PNorm = 74.4401, GNorm = 0.7507, lr_0 = 9.9828e-04
Validation auc = 0.614531
Epoch 76
Validation auc = 0.614968
Epoch 77
Validation auc = 0.617483
Epoch 78
Validation auc = 0.623114
Epoch 79
Validation auc = 0.641975
Epoch 80
Loss = 4.2351e-01, PNorm = 74.7959, GNorm = 0.5123, lr_0 = 9.9802e-04
Validation auc = 0.636234
Epoch 81
Validation auc = 0.612126
Epoch 82
Validation auc = 0.605183
Epoch 83
Validation auc = 0.605893
Epoch 84
Loss = 3.4140e-01, PNorm = 75.1212, GNorm = 0.4316, lr_0 = 9.9779e-04
Loss = 3.0137e-01, PNorm = 75.1498, GNorm = 2.2210, lr_0 = 9.9777e-04
Validation auc = 0.608080
Epoch 85
Validation auc = 0.608299
Epoch 86
Validation auc = 0.609993
Epoch 87
Validation auc = 0.599716
Epoch 88
Validation auc = 0.586486
Epoch 89
Loss = 3.8990e-01, PNorm = 75.5239, GNorm = 0.7768, lr_0 = 9.9752e-04
Loss = 4.3798e-01, PNorm = 75.5527, GNorm = 1.7343, lr_0 = 9.9750e-04
Validation auc = 0.590203
Epoch 90
Validation auc = 0.587579
Epoch 91
Validation auc = 0.588563
Epoch 92
Validation auc = 0.600809
Epoch 93
Validation auc = 0.601082
Epoch 94
Loss = 3.9679e-01, PNorm = 75.9001, GNorm = 0.8345, lr_0 = 9.9727e-04
Validation auc = 0.589547
Epoch 95
Validation auc = 0.607205
Epoch 96
Validation auc = 0.602941
Epoch 97
Validation auc = 0.578286
Epoch 98
Validation auc = 0.580418
Epoch 99
Loss = 2.7956e-01, PNorm = 76.3129, GNorm = 0.9841, lr_0 = 9.9701e-04
Validation auc = 0.602285
Epoch 100
Validation auc = 0.593757
Epoch 101
Validation auc = 0.601246
Epoch 102
Validation auc = 0.595944
Epoch 103
Loss = 3.1522e-01, PNorm = 76.7377, GNorm = 1.2536, lr_0 = 9.9678e-04
Loss = 3.7186e-01, PNorm = 76.7733, GNorm = 1.4372, lr_0 = 9.9676e-04
Validation auc = 0.603433
Epoch 104
Validation auc = 0.610048
Epoch 105
Validation auc = 0.612235
Epoch 106
Validation auc = 0.604636
Epoch 107
Validation auc = 0.601410
Epoch 108
Loss = 3.0688e-01, PNorm = 77.2220, GNorm = 0.6322, lr_0 = 9.9651e-04
Validation auc = 0.603051
Epoch 109
Validation auc = 0.591133
Epoch 110
Validation auc = 0.558550
Epoch 111
Validation auc = 0.608736
Epoch 112
Validation auc = 0.613492
Epoch 113
Loss = 2.2652e-01, PNorm = 77.6072, GNorm = 3.2204, lr_0 = 9.9627e-04
Validation auc = 0.585611
Epoch 114
Validation auc = 0.552974
Epoch 115
Validation auc = 0.552591
Epoch 116
Validation auc = 0.607041
Epoch 117
Loss = 2.4718e-01, PNorm = 77.9450, GNorm = 1.3915, lr_0 = 9.9604e-04
Loss = 3.9356e-02, PNorm = 77.9744, GNorm = 0.4575, lr_0 = 9.9602e-04
Validation auc = 0.633392
Epoch 118
Validation auc = 0.644161
Epoch 119
Validation auc = 0.633064
Epoch 120
Validation auc = 0.635906
Epoch 121
Validation auc = 0.649136
Epoch 122
Loss = 3.8170e-01, PNorm = 78.4279, GNorm = 0.6739, lr_0 = 9.9577e-04
Loss = 3.4728e-01, PNorm = 78.4598, GNorm = 0.5548, lr_0 = 9.9575e-04
Validation auc = 0.642029
Epoch 123
Validation auc = 0.603379
Epoch 124
Validation auc = 0.602340
Epoch 125
Validation auc = 0.611360
Epoch 126
Validation auc = 0.614039
Epoch 127
Loss = 2.8760e-01, PNorm = 78.8167, GNorm = 0.6603, lr_0 = 9.9552e-04
Validation auc = 0.606440
Epoch 128
Validation auc = 0.595670
Epoch 129
Validation auc = 0.612563
Epoch 130
Validation auc = 0.602340
Epoch 131
Validation auc = 0.608845
Epoch 132
Loss = 5.5037e-01, PNorm = 79.1637, GNorm = 5.5796, lr_0 = 9.9526e-04
Validation auc = 0.602449
Epoch 133
Validation auc = 0.604035
Epoch 134
Validation auc = 0.605292
Epoch 135
Validation auc = 0.603816
Epoch 136
Loss = 3.3257e-01, PNorm = 79.5185, GNorm = 2.5551, lr_0 = 9.9503e-04
Loss = 3.8840e-01, PNorm = 79.5444, GNorm = 3.9179, lr_0 = 9.9501e-04
Validation auc = 0.605948
Epoch 137
Validation auc = 0.605292
Epoch 138
Validation auc = 0.582276
Epoch 139
Validation auc = 0.568281
Epoch 140
Validation auc = 0.600098
Epoch 141
Loss = 1.2541e-01, PNorm = 79.9039, GNorm = 0.6937, lr_0 = 9.9477e-04
Validation auc = 0.608408
Epoch 142
Validation auc = 0.606221
Epoch 143
Validation auc = 0.608299
Epoch 144
Validation auc = 0.613984
Epoch 145
Validation auc = 0.623551
Epoch 146
Loss = 1.2898e-01, PNorm = 80.1772, GNorm = 0.8012, lr_0 = 9.9452e-04
Validation auc = 0.633556
Epoch 147
Validation auc = 0.633993
Epoch 148
Validation auc = 0.626175
Epoch 149
Validation auc = 0.614640
Epoch 150
Loss = 1.4709e-01, PNorm = 80.4396, GNorm = 2.4910, lr_0 = 9.9429e-04
Loss = 6.3230e-02, PNorm = 80.4574, GNorm = 1.7352, lr_0 = 9.9427e-04
Validation auc = 0.613547
Epoch 151
Validation auc = 0.612618
Epoch 152
Validation auc = 0.610321
Epoch 153
Validation auc = 0.586978
Epoch 154
Validation auc = 0.571452
Epoch 155
Loss = 1.7242e-01, PNorm = 80.7078, GNorm = 1.1143, lr_0 = 9.9403e-04
Loss = 5.7261e-02, PNorm = 80.7330, GNorm = 0.9602, lr_0 = 9.9401e-04
Validation auc = 0.574732
Epoch 156
Validation auc = 0.581730
Epoch 157
Validation auc = 0.580855
Epoch 158
Validation auc = 0.579543
Epoch 159
Validation auc = 0.581730
Epoch 160
Loss = 1.2592e-01, PNorm = 81.0285, GNorm = 0.8490, lr_0 = 9.9378e-04
Validation auc = 0.585994
Epoch 161
Validation auc = 0.580636
Epoch 162
Validation auc = 0.575443
Epoch 163
Validation auc = 0.576372
Epoch 164
Validation auc = 0.588673
Epoch 165
Loss = 1.6713e-01, PNorm = 81.3201, GNorm = 2.9848, lr_0 = 9.9351e-04
Validation auc = 0.595452
Epoch 166
Validation auc = 0.593429
Epoch 167
Validation auc = 0.592499
Epoch 168
Validation auc = 0.595233
Epoch 169
Loss = 8.7244e-02, PNorm = 81.5528, GNorm = 0.6484, lr_0 = 9.9329e-04
Loss = 1.3161e-01, PNorm = 81.5689, GNorm = 5.8435, lr_0 = 9.9327e-04
Validation auc = 0.608353
Epoch 170
Validation auc = 0.611469
Epoch 171
Validation auc = 0.599661
Epoch 172
Validation auc = 0.595452
Epoch 173
Validation auc = 0.596326
Epoch 174
Loss = 1.0827e-01, PNorm = 81.7939, GNorm = 1.5899, lr_0 = 9.9302e-04
Validation auc = 0.602230
Epoch 175
Validation auc = 0.608299
Epoch 176
Validation auc = 0.610649
Epoch 177
Validation auc = 0.601793
Epoch 178
Validation auc = 0.594468
Epoch 179
Loss = 6.3741e-02, PNorm = 82.0031, GNorm = 1.3954, lr_0 = 9.9277e-04
Validation auc = 0.590039
Epoch 180
Validation auc = 0.596272
Epoch 181
Validation auc = 0.606003
Epoch 182
Validation auc = 0.601738
Epoch 183
Loss = 4.7385e-02, PNorm = 82.2895, GNorm = 0.9759, lr_0 = 9.9253e-04
Validation auc = 0.595561
Epoch 184
Validation auc = 0.593702
Epoch 185
Validation auc = 0.596053
Epoch 186
Validation auc = 0.594358
Epoch 187
Validation auc = 0.593319
Epoch 188
Loss = 1.4119e-01, PNorm = 82.5690, GNorm = 1.2193, lr_0 = 9.9228e-04
Loss = 2.0540e-02, PNorm = 82.5872, GNorm = 0.4046, lr_0 = 9.9226e-04
Validation auc = 0.594850
Epoch 189
Validation auc = 0.597365
Epoch 190
Validation auc = 0.601738
Epoch 191
Validation auc = 0.588181
Epoch 192
Validation auc = 0.580855
Epoch 193
Loss = 7.7844e-02, PNorm = 82.7817, GNorm = 1.7313, lr_0 = 9.9204e-04
Validation auc = 0.584408
Epoch 194
Validation auc = 0.579379
Epoch 195
Validation auc = 0.577356
Epoch 196
Validation auc = 0.578668
Epoch 197
Validation auc = 0.578559
Epoch 198
Loss = 9.0540e-02, PNorm = 82.9448, GNorm = 0.7814, lr_0 = 9.9177e-04
Validation auc = 0.585502
Epoch 199
Validation auc = 0.588071
Epoch 200
Validation auc = 0.587798
Epoch 201
Validation auc = 0.582550
Epoch 202
Loss = 5.4091e-02, PNorm = 83.0495, GNorm = 0.5184, lr_0 = 9.9154e-04
Loss = 1.0812e-02, PNorm = 83.0597, GNorm = 0.3395, lr_0 = 9.9153e-04
Validation auc = 0.579980
Epoch 203
Validation auc = 0.580418
Epoch 204
Validation auc = 0.579762
Epoch 205
Validation auc = 0.585666
Epoch 206
Validation auc = 0.607205
Epoch 207
Loss = 1.5521e-01, PNorm = 83.2345, GNorm = 1.4551, lr_0 = 9.9128e-04
Loss = 5.5529e-03, PNorm = 83.2558, GNorm = 0.0740, lr_0 = 9.9126e-04
Validation auc = 0.614914
Epoch 208
Validation auc = 0.611962
Epoch 209
Validation auc = 0.619068
Epoch 210
Validation auc = 0.620545
Epoch 211
Validation auc = 0.622622
Epoch 212
Loss = 1.7049e-01, PNorm = 83.4801, GNorm = 0.7693, lr_0 = 9.9103e-04
Validation auc = 0.621529
Epoch 213
Validation auc = 0.620709
Epoch 214
Validation auc = 0.619998
Epoch 215
Validation auc = 0.619779
Epoch 216
Loss = 5.6344e-02, PNorm = 83.6565, GNorm = 0.1062, lr_0 = 9.9079e-04
Validation auc = 0.621966
Epoch 217
Validation auc = 0.626667
Epoch 218
Validation auc = 0.634048
Epoch 219
Validation auc = 0.642412
Epoch 220
Validation auc = 0.643615
Epoch 221
Loss = 5.1080e-02, PNorm = 83.7772, GNorm = 0.4147, lr_0 = 9.9054e-04
Loss = 1.3839e-01, PNorm = 83.7875, GNorm = 3.7737, lr_0 = 9.9052e-04
Validation auc = 0.640007
Epoch 222
Validation auc = 0.641975
Epoch 223
Validation auc = 0.641045
Epoch 224
Validation auc = 0.625683
Epoch 225
Validation auc = 0.616280
Epoch 226
Loss = 1.4174e-01, PNorm = 83.9194, GNorm = 3.6847, lr_0 = 9.9030e-04
Validation auc = 0.618303
Epoch 227
Validation auc = 0.622458
Epoch 228
Validation auc = 0.615788
Epoch 229
Validation auc = 0.605128
Epoch 230
Validation auc = 0.612344
Epoch 231
Loss = 3.4125e-01, PNorm = 84.2905, GNorm = 1.4362, lr_0 = 9.9003e-04
Validation auc = 0.620654
Epoch 232
Validation auc = 0.679641
Epoch 233
Validation auc = 0.655204
Epoch 234
Validation auc = 0.649683
Epoch 235
Loss = 1.4535e-01, PNorm = 84.8785, GNorm = 1.4672, lr_0 = 9.8980e-04
Loss = 3.0356e-01, PNorm = 84.9145, GNorm = 3.5093, lr_0 = 9.8979e-04
Validation auc = 0.647059
Epoch 236
Validation auc = 0.657501
Epoch 237
Validation auc = 0.673136
Epoch 238
Validation auc = 0.688552
Epoch 239
Validation auc = 0.688716
Epoch 240
Loss = 4.2234e-02, PNorm = 85.2919, GNorm = 0.9674, lr_0 = 9.8954e-04
Loss = 1.0719e-02, PNorm = 85.3135, GNorm = 0.1627, lr_0 = 9.8952e-04
Validation auc = 0.691668
Epoch 241
Validation auc = 0.709545
Epoch 242
Validation auc = 0.729609
Epoch 243
Validation auc = 0.717964
Epoch 244
Validation auc = 0.703750
Epoch 245
Loss = 4.7168e-02, PNorm = 85.5401, GNorm = 1.0782, lr_0 = 9.8930e-04
Validation auc = 0.694402
Epoch 246
Validation auc = 0.688388
Epoch 247
Validation auc = 0.692871
Epoch 248
Validation auc = 0.695987
Epoch 249
Loss = 9.5814e-02, PNorm = 85.7255, GNorm = 1.9054, lr_0 = 9.8905e-04
Validation auc = 0.693527
Epoch 250
Validation auc = 0.678165
Epoch 251
Validation auc = 0.681172
Epoch 252
Validation auc = 0.674885
Epoch 253
Validation auc = 0.673354
Epoch 254
Loss = 6.6043e-02, PNorm = 85.9022, GNorm = 1.8598, lr_0 = 9.8880e-04
Loss = 8.3139e-03, PNorm = 85.9132, GNorm = 0.1739, lr_0 = 9.8879e-04
Validation auc = 0.674995
Epoch 255
Validation auc = 0.679259
Epoch 256
Validation auc = 0.683304
Epoch 257
Validation auc = 0.671988
Epoch 258
Validation auc = 0.659742
Epoch 259
Loss = 1.7433e-01, PNorm = 86.0642, GNorm = 3.1017, lr_0 = 9.8856e-04
Validation auc = 0.668762
Epoch 260
Validation auc = 0.678275
Epoch 261
Validation auc = 0.674557
Epoch 262
Validation auc = 0.673464
Epoch 263
Validation auc = 0.674885
Epoch 264
Loss = 6.2529e-02, PNorm = 86.2688, GNorm = 0.3655, lr_0 = 9.8830e-04
Validation auc = 0.672480
Epoch 265
Validation auc = 0.655040
Epoch 266
Validation auc = 0.628963
Epoch 267
Validation auc = 0.601684
Epoch 268
Loss = 2.1721e-01, PNorm = 86.5532, GNorm = 1.0515, lr_0 = 9.8807e-04
Loss = 7.2397e-03, PNorm = 86.5738, GNorm = 0.1127, lr_0 = 9.8805e-04
Validation auc = 0.610485
Epoch 269
Validation auc = 0.613110
Epoch 270
Validation auc = 0.629784
Epoch 271
Validation auc = 0.656845
Epoch 272
Validation auc = 0.662639
Epoch 273
Loss = 9.6300e-02, PNorm = 86.8403, GNorm = 0.9717, lr_0 = 9.8781e-04
Loss = 4.0546e-02, PNorm = 86.8570, GNorm = 0.6719, lr_0 = 9.8779e-04
Validation auc = 0.657063
Epoch 274
Validation auc = 0.655095
Epoch 275
Validation auc = 0.654767
Epoch 276
Validation auc = 0.649082
Epoch 277
Validation auc = 0.646676
Epoch 278
Loss = 7.6169e-02, PNorm = 87.0561, GNorm = 1.0730, lr_0 = 9.8756e-04
Validation auc = 0.642357
Epoch 279
Validation auc = 0.639733
Epoch 280
Validation auc = 0.636508
Epoch 281
Validation auc = 0.633009
Epoch 282
Validation auc = 0.631533
Epoch 283
Loss = 1.9617e-03, PNorm = 87.2122, GNorm = 0.0323, lr_0 = 9.8730e-04
Validation auc = 0.630713
Epoch 284
Validation auc = 0.630494
Epoch 285
Validation auc = 0.631260
Epoch 286
Validation auc = 0.628909
Epoch 287
Loss = 1.4895e-01, PNorm = 87.2748, GNorm = 0.5841, lr_0 = 9.8707e-04
Loss = 6.0116e-04, PNorm = 87.2812, GNorm = 0.0109, lr_0 = 9.8705e-04
Validation auc = 0.625629
Epoch 288
Validation auc = 0.631533
Epoch 289
Validation auc = 0.641920
Epoch 290
Validation auc = 0.650339
Epoch 291
Validation auc = 0.662311
Epoch 292
Loss = 2.2484e-02, PNorm = 87.4084, GNorm = 0.6241, lr_0 = 9.8683e-04
Validation auc = 0.669090
Epoch 293
Validation auc = 0.674175
Epoch 294
Validation auc = 0.677564
Epoch 295
Validation auc = 0.680953
Epoch 296
Validation auc = 0.683687
Epoch 297
Loss = 9.3589e-02, PNorm = 87.5534, GNorm = 0.5769, lr_0 = 9.8656e-04
Validation auc = 0.686366
Epoch 298
Validation auc = 0.687732
Epoch 299
Validation auc = 0.686694
Epoch 300
Validation auc = 0.685491
Epoch 301
Loss = 3.1164e-03, PNorm = 87.6420, GNorm = 0.0770, lr_0 = 9.8634e-04
Loss = 6.5587e-03, PNorm = 87.6477, GNorm = 0.1158, lr_0 = 9.8632e-04
Validation auc = 0.684507
Epoch 302
Validation auc = 0.681445
Epoch 303
Validation auc = 0.681008
Epoch 304
Validation auc = 0.679259
Epoch 305
Validation auc = 0.667778
Epoch 306
Loss = 2.3171e-01, PNorm = 87.7053, GNorm = 6.6104, lr_0 = 9.8607e-04
Loss = 2.7985e-02, PNorm = 87.7128, GNorm = 0.9143, lr_0 = 9.8606e-04
Validation auc = 0.665482
Epoch 307
Validation auc = 0.661710
Epoch 308
Validation auc = 0.662311
Epoch 309
Validation auc = 0.664498
Epoch 310
Validation auc = 0.667505
Epoch 311
Loss = 1.3536e-01, PNorm = 87.8362, GNorm = 3.0211, lr_0 = 9.8583e-04
Validation auc = 0.671168
Epoch 312
Validation auc = 0.665209
Epoch 313
Validation auc = 0.661819
Epoch 314
Validation auc = 0.661765
Epoch 315
Validation auc = 0.661491
Epoch 316
Loss = 1.4595e-01, PNorm = 88.0537, GNorm = 1.0289, lr_0 = 9.8557e-04
Validation auc = 0.668708
Epoch 317
Validation auc = 0.673682
Epoch 318
Validation auc = 0.675487
Epoch 319
Validation auc = 0.673300
Epoch 320
Loss = 7.5834e-02, PNorm = 88.2029, GNorm = 0.5539, lr_0 = 9.8534e-04
Loss = 4.0801e-03, PNorm = 88.2117, GNorm = 0.0830, lr_0 = 9.8532e-04
Validation auc = 0.674229
Epoch 321
Validation auc = 0.674010
Epoch 322
Validation auc = 0.679259
Epoch 323
Validation auc = 0.676143
Epoch 324
Validation auc = 0.640553
Epoch 325
Loss = 8.8425e-01, PNorm = 88.3053, GNorm = 11.7269, lr_0 = 9.8509e-04
Validation auc = 0.671714
Epoch 326
Validation auc = 0.683031
Epoch 327
Validation auc = 0.694675
Epoch 328
Validation auc = 0.683468
Epoch 329
Validation auc = 0.649519
Epoch 330
Loss = 2.8159e-01, PNorm = 88.6700, GNorm = 1.3789, lr_0 = 9.8483e-04
Validation auc = 0.653455
Epoch 331
Validation auc = 0.669036
Epoch 332
Validation auc = 0.667942
Epoch 333
Validation auc = 0.671550
Epoch 334
Loss = 9.5655e-02, PNorm = 89.0067, GNorm = 0.4290, lr_0 = 9.8461e-04
Loss = 3.9790e-02, PNorm = 89.0299, GNorm = 0.3015, lr_0 = 9.8459e-04
Validation auc = 0.671660
Epoch 335
Validation auc = 0.671988
Epoch 336
Validation auc = 0.665592
Epoch 337
Validation auc = 0.657282
Epoch 338
Validation auc = 0.650230
Epoch 339
Loss = 4.1206e-02, PNorm = 89.2851, GNorm = 0.3331, lr_0 = 9.8434e-04
Loss = 3.8774e-02, PNorm = 89.3000, GNorm = 0.5014, lr_0 = 9.8433e-04
Validation auc = 0.645091
Epoch 340
Validation auc = 0.643943
Epoch 341
Validation auc = 0.645856
Epoch 342
Validation auc = 0.643669
Epoch 343
Validation auc = 0.643997
Epoch 344
Loss = 2.0935e-02, PNorm = 89.4633, GNorm = 0.6408, lr_0 = 9.8410e-04
Validation auc = 0.643396
Epoch 345
Validation auc = 0.644435
Epoch 346
Validation auc = 0.644544
Epoch 347
Validation auc = 0.651268
Epoch 348
Validation auc = 0.655696
Epoch 349
Loss = 1.2007e-01, PNorm = 89.5875, GNorm = 0.6740, lr_0 = 9.8384e-04
Validation auc = 0.660234
Epoch 350
Validation auc = 0.663951
Epoch 351
Validation auc = 0.666630
Epoch 352
Validation auc = 0.672152
Epoch 353
Loss = 5.3323e-02, PNorm = 89.6543, GNorm = 1.3002, lr_0 = 9.8361e-04
Loss = 1.6822e-03, PNorm = 89.6585, GNorm = 0.0493, lr_0 = 9.8359e-04
Validation auc = 0.674776
Epoch 354
Validation auc = 0.675487
Epoch 355
Validation auc = 0.675541
Epoch 356
Validation auc = 0.674175
Epoch 357
Validation auc = 0.671605
Epoch 358
Loss = 3.6059e-03, PNorm = 89.7207, GNorm = 0.0358, lr_0 = 9.8335e-04
Validation auc = 0.670676
Epoch 359
Validation auc = 0.670785
Epoch 360
Validation auc = 0.669801
Epoch 361
Validation auc = 0.669090
Epoch 362
Validation auc = 0.668325
Epoch 363
Loss = 3.4490e-04, PNorm = 89.7630, GNorm = 0.0067, lr_0 = 9.8311e-04
Validation auc = 0.668216
Epoch 364
Validation auc = 0.668052
Epoch 365
Validation auc = 0.667450
Epoch 366
Validation auc = 0.665920
Epoch 367
Loss = 1.8603e-02, PNorm = 89.7837, GNorm = 1.4342, lr_0 = 9.8288e-04
Loss = 4.9219e-04, PNorm = 89.7860, GNorm = 0.0123, lr_0 = 9.8286e-04
Validation auc = 0.663842
Epoch 368
Validation auc = 0.661546
Epoch 369
Validation auc = 0.662038
Epoch 370
Validation auc = 0.665318
Epoch 371
Validation auc = 0.669692
Epoch 372
Loss = 2.3485e-03, PNorm = 89.8101, GNorm = 0.0470, lr_0 = 9.8262e-04
Loss = 6.6731e-01, PNorm = 89.8075, GNorm = 16.5568, lr_0 = 9.8260e-04
Validation auc = 0.675159
Epoch 373
Validation auc = 0.667560
Epoch 374
Validation auc = 0.649738
Epoch 375
Validation auc = 0.633392
Epoch 376
Validation auc = 0.615898
Epoch 377
Loss = 4.0521e-02, PNorm = 89.9162, GNorm = 1.0064, lr_0 = 9.8237e-04
Validation auc = 0.611743
Epoch 378
Validation auc = 0.619232
Epoch 379
Validation auc = 0.611141
Epoch 380
Validation auc = 0.614859
Epoch 381
Validation auc = 0.623879
Epoch 382
Loss = 8.0057e-03, PNorm = 90.0890, GNorm = 0.0933, lr_0 = 9.8211e-04
Validation auc = 0.632025
Epoch 383
Validation auc = 0.636836
Epoch 384
Validation auc = 0.639187
Epoch 385
Validation auc = 0.646895
Epoch 386
Loss = 3.5118e-02, PNorm = 90.1962, GNorm = 1.4268, lr_0 = 9.8189e-04
Loss = 1.2988e-02, PNorm = 90.2021, GNorm = 0.5011, lr_0 = 9.8187e-04
Validation auc = 0.649792
Epoch 387
Validation auc = 0.651979
Epoch 388
Validation auc = 0.650011
Epoch 389
Validation auc = 0.645309
Epoch 390
Validation auc = 0.643560
Epoch 391
Loss = 7.1475e-03, PNorm = 90.2633, GNorm = 0.5074, lr_0 = 9.8163e-04
Validation auc = 0.638366
Epoch 392
Validation auc = 0.642685
Epoch 393
Validation auc = 0.665099
Epoch 394
Validation auc = 0.673190
Epoch 395
Validation auc = 0.673245
Epoch 396
Loss = 4.7680e-03, PNorm = 90.3235, GNorm = 0.0723, lr_0 = 9.8138e-04
Validation auc = 0.668489
Epoch 397
Validation auc = 0.679696
Epoch 398
Validation auc = 0.695167
Epoch 399
Validation auc = 0.706976
Epoch 400
Loss = 1.6324e-01, PNorm = 90.3936, GNorm = 1.1936, lr_0 = 9.8116e-04
Loss = 4.6316e-01, PNorm = 90.4004, GNorm = 5.7079, lr_0 = 9.8114e-04
Validation auc = 0.715941
Epoch 401
Validation auc = 0.716597
Epoch 402
Validation auc = 0.713973
Epoch 403
Validation auc = 0.709983
Epoch 404
Validation auc = 0.707905
Epoch 405
Loss = 4.0587e-02, PNorm = 90.5632, GNorm = 0.6505, lr_0 = 9.8089e-04
Loss = 1.7655e-02, PNorm = 90.5775, GNorm = 0.2237, lr_0 = 9.8088e-04
Validation auc = 0.702985
Epoch 406
Validation auc = 0.709381
Epoch 407
Validation auc = 0.711349
Epoch 408
Validation auc = 0.714793
Epoch 409
Validation auc = 0.716925
Epoch 410
Loss = 1.2837e-02, PNorm = 90.7400, GNorm = 0.2094, lr_0 = 9.8065e-04
Validation auc = 0.719222
Epoch 411
Validation auc = 0.719550
Epoch 412
Validation auc = 0.712661
Epoch 413
Validation auc = 0.711623
Epoch 414
Validation auc = 0.709490
Epoch 415
Loss = 1.3826e-02, PNorm = 90.8699, GNorm = 0.5131, lr_0 = 9.8039e-04
Validation auc = 0.708670
Epoch 416
Validation auc = 0.707796
Epoch 417
Validation auc = 0.706265
Epoch 418
Validation auc = 0.705500
Epoch 419
Loss = 4.9869e-03, PNorm = 90.9597, GNorm = 0.2239, lr_0 = 9.8016e-04
Loss = 3.2024e-03, PNorm = 90.9664, GNorm = 0.2026, lr_0 = 9.8015e-04
Validation auc = 0.704680
Epoch 420
Validation auc = 0.697955
Epoch 421
Validation auc = 0.660726
Epoch 422
Validation auc = 0.672206
Epoch 423
Validation auc = 0.702766
Epoch 424
Loss = 1.2809e-01, PNorm = 90.9867, GNorm = 1.1903, lr_0 = 9.7990e-04
Validation auc = 0.711021
Epoch 425
Validation auc = 0.715449
Epoch 426
Validation auc = 0.705609
Epoch 427
Validation auc = 0.697682
Epoch 428
Validation auc = 0.692871
Epoch 429
Loss = 8.6985e-02, PNorm = 91.0532, GNorm = 0.3450, lr_0 = 9.7966e-04
Validation auc = 0.718128
Epoch 430
Validation auc = 0.713809
Epoch 431
Validation auc = 0.710256
Epoch 432
Validation auc = 0.710092
Epoch 433
Loss = 6.3262e-02, PNorm = 91.1994, GNorm = 0.2441, lr_0 = 9.7942e-04
Validation auc = 0.698502
Epoch 434
Validation auc = 0.696261
Epoch 435
Validation auc = 0.681719
Epoch 436
Validation auc = 0.677181
Epoch 437
Validation auc = 0.682921
Epoch 438
Loss = 1.6958e-01, PNorm = 91.3639, GNorm = 1.0250, lr_0 = 9.7917e-04
Loss = 3.2847e-02, PNorm = 91.3735, GNorm = 0.7146, lr_0 = 9.7916e-04
Validation auc = 0.689864
Epoch 439
Validation auc = 0.696698
Epoch 440
Validation auc = 0.704133
Epoch 441
Validation auc = 0.713153
Epoch 442
Validation auc = 0.715340
Epoch 443
Loss = 2.1221e-01, PNorm = 91.4956, GNorm = 1.2727, lr_0 = 9.7893e-04
Validation auc = 0.717253
Epoch 444
Validation auc = 0.720042
Epoch 445
Validation auc = 0.721299
Epoch 446
Validation auc = 0.722720
Epoch 447
Validation auc = 0.722228
Epoch 448
Loss = 9.7007e-03, PNorm = 91.6014, GNorm = 0.3139, lr_0 = 9.7867e-04
Validation auc = 0.721190
Epoch 449
Validation auc = 0.717691
Epoch 450
Validation auc = 0.713099
Epoch 451
Validation auc = 0.710475
Epoch 452
Loss = 4.2414e-03, PNorm = 91.6827, GNorm = 0.0692, lr_0 = 9.7845e-04
Loss = 1.9933e-03, PNorm = 91.6885, GNorm = 0.1362, lr_0 = 9.7843e-04
Validation auc = 0.708670
Epoch 453
Validation auc = 0.707194
Epoch 454
Validation auc = 0.705281
Epoch 455
Validation auc = 0.702165
Epoch 456
Validation auc = 0.700798
Epoch 457
Loss = 5.2062e-03, PNorm = 91.7631, GNorm = 0.4096, lr_0 = 9.7819e-04
Loss = 3.1254e-04, PNorm = 91.7674, GNorm = 0.0067, lr_0 = 9.7817e-04
Validation auc = 0.698065
Epoch 458
Validation auc = 0.700525
Epoch 459
Validation auc = 0.705062
Epoch 460
Validation auc = 0.697682
Epoch 461
Validation auc = 0.696643
Epoch 462
Loss = 9.4176e-03, PNorm = 91.8651, GNorm = 0.5700, lr_0 = 9.7794e-04
Validation auc = 0.696425
Epoch 463
Validation auc = 0.690684
Epoch 464
Validation auc = 0.688607
Epoch 465
Validation auc = 0.689864
Epoch 466
Loss = 1.5653e-01, PNorm = 92.0311, GNorm = 0.9494, lr_0 = 9.7770e-04
Validation auc = 0.689536
Epoch 467
Validation auc = 0.688170
Epoch 468
Validation auc = 0.684999
Epoch 469
Validation auc = 0.680844
Epoch 470
Validation auc = 0.679860
Epoch 471
Loss = 5.3000e-02, PNorm = 92.1841, GNorm = 0.9053, lr_0 = 9.7746e-04
Loss = 2.1768e-02, PNorm = 92.1971, GNorm = 0.4608, lr_0 = 9.7744e-04
Validation auc = 0.686311
Epoch 472
Validation auc = 0.687514
Epoch 473
Validation auc = 0.688170
Epoch 474
Validation auc = 0.689482
Epoch 475
Validation auc = 0.692215
Epoch 476
Loss = 2.9342e-03, PNorm = 92.3957, GNorm = 0.0363, lr_0 = 9.7721e-04
Validation auc = 0.694238
Epoch 477
Validation auc = 0.689974
Epoch 478
Validation auc = 0.693309
Epoch 479
Validation auc = 0.697955
Epoch 480
Validation auc = 0.675869
Epoch 481
Loss = 1.1732e-02, PNorm = 92.5185, GNorm = 0.2625, lr_0 = 9.7695e-04
Validation auc = 0.632134
Epoch 482
Validation auc = 0.597966
Epoch 483
Validation auc = 0.569812
Epoch 484
Validation auc = 0.545211
Epoch 485
Loss = 2.2746e-01, PNorm = 92.6654, GNorm = 6.0542, lr_0 = 9.7673e-04
Loss = 2.2807e-01, PNorm = 92.6777, GNorm = 3.7957, lr_0 = 9.7671e-04
Validation auc = 0.573365
Epoch 486
Validation auc = 0.579324
Epoch 487
Validation auc = 0.577028
Epoch 488
Validation auc = 0.568500
Epoch 489
Validation auc = 0.594194
Epoch 490
Loss = 2.9614e-02, PNorm = 92.8615, GNorm = 0.5574, lr_0 = 9.7647e-04
Loss = 7.3226e-03, PNorm = 92.8741, GNorm = 0.1380, lr_0 = 9.7645e-04
Validation auc = 0.601848
Epoch 491
Validation auc = 0.610048
Epoch 492
Validation auc = 0.613602
Epoch 493
Validation auc = 0.616062
Epoch 494
Validation auc = 0.619232
Epoch 495
Loss = 5.9614e-02, PNorm = 92.9861, GNorm = 1.0827, lr_0 = 9.7623e-04
Validation auc = 0.628089
Epoch 496
Validation auc = 0.634212
Epoch 497
Validation auc = 0.639023
Epoch 498
Validation auc = 0.641100
Epoch 499
Loss = 2.8357e-02, PNorm = 93.0766, GNorm = 0.1397, lr_0 = 9.7599e-04
Validation auc = 0.637984
Epoch 500
Validation auc = 0.636344
Epoch 501
Validation auc = 0.633446
Epoch 502
Validation auc = 0.636344
Epoch 503
Validation auc = 0.639624
Epoch 504
Loss = 1.3603e-02, PNorm = 93.1504, GNorm = 0.1204, lr_0 = 9.7574e-04
Loss = 6.8462e-04, PNorm = 93.1554, GNorm = 0.0422, lr_0 = 9.7573e-04
Validation auc = 0.638749
Epoch 505
Validation auc = 0.639187
Epoch 506
Validation auc = 0.639023
Epoch 507
Validation auc = 0.633556
Epoch 508
Validation auc = 0.627433
Epoch 509
Loss = 3.3473e-03, PNorm = 93.2002, GNorm = 0.0484, lr_0 = 9.7550e-04
Validation auc = 0.624645
Epoch 510
Validation auc = 0.622731
Epoch 511
Validation auc = 0.621802
Epoch 512
Validation auc = 0.621693
Epoch 513
Validation auc = 0.622513
Epoch 514
Loss = 5.9957e-03, PNorm = 93.2356, GNorm = 0.0875, lr_0 = 9.7524e-04
Validation auc = 0.618795
Epoch 515
Validation auc = 0.611962
Epoch 516
Validation auc = 0.611196
Epoch 517
Validation auc = 0.617975
Epoch 518
Loss = 2.1531e-02, PNorm = 93.3159, GNorm = 0.0193, lr_0 = 9.7502e-04
Loss = 2.5373e-03, PNorm = 93.3239, GNorm = 0.0575, lr_0 = 9.7500e-04
Validation auc = 0.625519
Epoch 519
Validation auc = 0.627761
Epoch 520
Validation auc = 0.627269
Epoch 521
Validation auc = 0.628253
Epoch 522
Validation auc = 0.626667
Epoch 523
Loss = 7.2419e-02, PNorm = 93.4181, GNorm = 0.4521, lr_0 = 9.7476e-04
Loss = 1.0904e-02, PNorm = 93.4240, GNorm = 0.3495, lr_0 = 9.7474e-04
Validation auc = 0.622349
Epoch 524
Validation auc = 0.620162
Epoch 525
Validation auc = 0.618522
Epoch 526
Validation auc = 0.618030
Epoch 527
Validation auc = 0.616827
Epoch 528
Loss = 4.9089e-03, PNorm = 93.5027, GNorm = 0.0863, lr_0 = 9.7452e-04
Validation auc = 0.613438
Epoch 529
Validation auc = 0.610485
Epoch 530
Validation auc = 0.608736
Epoch 531
Validation auc = 0.610759
Epoch 532
Validation auc = 0.611907
Epoch 533
Loss = 1.9059e-03, PNorm = 93.5833, GNorm = 0.0593, lr_0 = 9.7426e-04
Validation auc = 0.612235
Epoch 534
Validation auc = 0.613492
Epoch 535
Validation auc = 0.613274
Epoch 536
Validation auc = 0.613711
Epoch 537
Loss = 1.4430e-02, PNorm = 93.6225, GNorm = 0.0119, lr_0 = 9.7403e-04
Loss = 7.6662e-01, PNorm = 93.6218, GNorm = 5.4870, lr_0 = 9.7401e-04
Validation auc = 0.613328
Epoch 538
Validation auc = 0.590969
Epoch 539
Validation auc = 0.628581
Epoch 540
Validation auc = 0.638366
Epoch 541
Validation auc = 0.647496
Epoch 542
Loss = 1.0082e-02, PNorm = 93.6731, GNorm = 0.1344, lr_0 = 9.7379e-04
Validation auc = 0.653346
Epoch 543
Validation auc = 0.651760
Epoch 544
Validation auc = 0.648863
Epoch 545
Validation auc = 0.646512
Epoch 546
Validation auc = 0.640280
Epoch 547
Loss = 2.3504e-02, PNorm = 93.7706, GNorm = 0.7189, lr_0 = 9.7353e-04
Validation auc = 0.635086
Epoch 548
Validation auc = 0.635196
Epoch 549
Validation auc = 0.636125
Epoch 550
Validation auc = 0.631752
Epoch 551
Loss = 7.0791e-03, PNorm = 93.8330, GNorm = 0.0857, lr_0 = 9.7331e-04
Loss = 1.0240e-02, PNorm = 93.8366, GNorm = 0.1701, lr_0 = 9.7329e-04
Validation auc = 0.627542
Epoch 552
Validation auc = 0.626066
Epoch 553
Validation auc = 0.624754
Epoch 554
Validation auc = 0.623661
Epoch 555
Validation auc = 0.623715
Epoch 556
Loss = 9.1954e-03, PNorm = 93.8814, GNorm = 0.0788, lr_0 = 9.7305e-04
Loss = 1.7830e-02, PNorm = 93.8846, GNorm = 0.6220, lr_0 = 9.7303e-04
Validation auc = 0.623770
Epoch 557
Validation auc = 0.624317
Epoch 558
Validation auc = 0.627214
Epoch 559
Validation auc = 0.628963
Epoch 560
Validation auc = 0.627761
Epoch 561
Loss = 2.5652e-03, PNorm = 93.9197, GNorm = 0.0707, lr_0 = 9.7281e-04
Validation auc = 0.626777
Epoch 562
Validation auc = 0.626339
Epoch 563
Validation auc = 0.623934
Epoch 564
Validation auc = 0.622294
Epoch 565
Validation auc = 0.620545
Epoch 566
Loss = 6.8808e-03, PNorm = 93.9502, GNorm = 0.1136, lr_0 = 9.7255e-04
Validation auc = 0.619724
Epoch 567
Validation auc = 0.618631
Epoch 568
Validation auc = 0.616062
Epoch 569
Validation auc = 0.614804
Epoch 570
Loss = 1.8800e-03, PNorm = 94.0025, GNorm = 0.0262, lr_0 = 9.7232e-04
Loss = 3.6745e-03, PNorm = 94.0070, GNorm = 0.1343, lr_0 = 9.7231e-04
Validation auc = 0.613219
Epoch 571
Validation auc = 0.612946
Epoch 572
Validation auc = 0.613328
Epoch 573
Validation auc = 0.618686
Epoch 574
Validation auc = 0.619014
Epoch 575
Loss = 1.5396e-03, PNorm = 94.0468, GNorm = 0.0319, lr_0 = 9.7208e-04
Validation auc = 0.620216
Epoch 576
Validation auc = 0.620654
Epoch 577
Validation auc = 0.625027
Epoch 578
Validation auc = 0.629401
Epoch 579
Validation auc = 0.632626
Epoch 580
Loss = 3.4274e-03, PNorm = 94.1055, GNorm = 0.0356, lr_0 = 9.7182e-04
Validation auc = 0.634430
Epoch 581
Validation auc = 0.636890
Epoch 582
Validation auc = 0.638749
Epoch 583
Validation auc = 0.640061
Epoch 584
Loss = 9.7155e-03, PNorm = 94.1354, GNorm = 0.0224, lr_0 = 9.7160e-04
Loss = 6.8991e-02, PNorm = 94.1395, GNorm = 3.5331, lr_0 = 9.7158e-04
Validation auc = 0.638913
Epoch 585
Validation auc = 0.635961
Epoch 586
Validation auc = 0.633337
Epoch 587
Validation auc = 0.630330
Epoch 588
Validation auc = 0.630276
Epoch 589
Loss = 3.6876e-02, PNorm = 94.2239, GNorm = 0.0338, lr_0 = 9.7134e-04
Loss = 2.7251e-03, PNorm = 94.2298, GNorm = 0.0483, lr_0 = 9.7132e-04
Validation auc = 0.630604
Epoch 590
Validation auc = 0.631861
Epoch 591
Validation auc = 0.633118
Epoch 592
Validation auc = 0.635032
Epoch 593
Validation auc = 0.636234
Epoch 594
Loss = 8.8066e-04, PNorm = 94.2809, GNorm = 0.0132, lr_0 = 9.7110e-04
Validation auc = 0.637164
Epoch 595
Validation auc = 0.637437
Epoch 596
Validation auc = 0.637218
Epoch 597
Validation auc = 0.637546
Epoch 598
Validation auc = 0.639241
Epoch 599
Loss = 4.5079e-03, PNorm = 94.3169, GNorm = 0.1549, lr_0 = 9.7084e-04
Validation auc = 0.639405
Epoch 600
Validation auc = 0.637382
Epoch 601
Validation auc = 0.630932
Epoch 602
Validation auc = 0.625246
Epoch 603
Loss = 3.2109e-03, PNorm = 94.3561, GNorm = 0.2618, lr_0 = 9.7062e-04
Loss = 8.5398e-04, PNorm = 94.3611, GNorm = 0.0285, lr_0 = 9.7060e-04
Validation auc = 0.620271
Epoch 604
Validation auc = 0.618740
Epoch 605
Validation auc = 0.621474
Epoch 606
Validation auc = 0.625301
Epoch 607
Validation auc = 0.634430
Epoch 608
Loss = 1.1760e-03, PNorm = 94.4487, GNorm = 0.0340, lr_0 = 9.7036e-04
Validation auc = 0.644107
Epoch 609
Validation auc = 0.653674
Epoch 610
Validation auc = 0.658758
Epoch 611
Validation auc = 0.662913
Epoch 612
Validation auc = 0.663787
Epoch 613
Loss = 1.3946e-03, PNorm = 94.5098, GNorm = 0.0413, lr_0 = 9.7012e-04
Validation auc = 0.658867
Epoch 614
Validation auc = 0.647332
Epoch 615
Validation auc = 0.642303
Epoch 616
Validation auc = 0.639952
Epoch 617
Loss = 4.6974e-03, PNorm = 94.5936, GNorm = 0.2435, lr_0 = 9.6990e-04
Loss = 1.0493e-02, PNorm = 94.6045, GNorm = 0.2202, lr_0 = 9.6988e-04
Validation auc = 0.639132
Epoch 618
Validation auc = 0.635469
Epoch 619
Validation auc = 0.626777
Epoch 620
Validation auc = 0.615132
Epoch 621
Validation auc = 0.609283
Epoch 622
Loss = 2.2564e-02, PNorm = 94.7273, GNorm = 0.3841, lr_0 = 9.6964e-04
Loss = 9.0301e-03, PNorm = 94.7373, GNorm = 0.2319, lr_0 = 9.6962e-04
Validation auc = 0.607971
Epoch 623
Validation auc = 0.608517
Epoch 624
Validation auc = 0.609720
Epoch 625
Validation auc = 0.611907
Epoch 626
Validation auc = 0.612180
Epoch 627
Loss = 1.4751e-02, PNorm = 94.8511, GNorm = 1.4964, lr_0 = 9.6940e-04
Validation auc = 0.615460
Epoch 628
Validation auc = 0.597256
Epoch 629
Validation auc = 0.561338
Epoch 630
Validation auc = 0.579707
Epoch 631
Validation auc = 0.583588
Epoch 632
Loss = 3.8411e-01, PNorm = 95.2370, GNorm = 4.2709, lr_0 = 9.6914e-04
Validation auc = 0.572327
Epoch 633
Validation auc = 0.564126
Epoch 634
Validation auc = 0.576208
Epoch 635
Validation auc = 0.588181
Epoch 636
Loss = 1.3089e-01, PNorm = 95.7060, GNorm = 2.9581, lr_0 = 9.6892e-04
Loss = 2.5917e-01, PNorm = 95.7311, GNorm = 6.8497, lr_0 = 9.6890e-04
Validation auc = 0.593374
Epoch 637
Validation auc = 0.589985
Epoch 638
Validation auc = 0.589383
Epoch 639
Validation auc = 0.588509
Epoch 640
Validation auc = 0.585502
Epoch 641
Loss = 4.9880e-02, PNorm = 96.0442, GNorm = 0.7189, lr_0 = 9.6866e-04
Validation auc = 0.585885
Epoch 642
Validation auc = 0.586978
Epoch 643
Validation auc = 0.586103
Epoch 644
Validation auc = 0.585830
Epoch 645
Validation auc = 0.586814
Epoch 646
Loss = 5.5184e-02, PNorm = 96.2519, GNorm = 0.9311, lr_0 = 9.6842e-04
Validation auc = 0.585721
Epoch 647
Validation auc = 0.576482
Epoch 648
Validation auc = 0.582604
Epoch 649
Validation auc = 0.588563
Epoch 650
Loss = 6.7601e-02, PNorm = 96.4324, GNorm = 0.1263, lr_0 = 9.6820e-04
Loss = 6.0163e-03, PNorm = 96.4456, GNorm = 0.1734, lr_0 = 9.6818e-04
Validation auc = 0.590914
Epoch 651
Validation auc = 0.598950
Epoch 652
Validation auc = 0.604199
Epoch 653
Validation auc = 0.609009
Epoch 654
Validation auc = 0.613984
Epoch 655
Loss = 2.3561e-02, PNorm = 96.5936, GNorm = 0.1832, lr_0 = 9.6794e-04
Loss = 2.7224e-03, PNorm = 96.6033, GNorm = 0.0967, lr_0 = 9.6792e-04
Validation auc = 0.618248
Epoch 656
Validation auc = 0.623497
Epoch 657
Validation auc = 0.625847
Epoch 658
Validation auc = 0.628581
Epoch 659
Validation auc = 0.630221
Epoch 660
Loss = 5.8297e-03, PNorm = 96.6913, GNorm = 0.0959, lr_0 = 9.6770e-04
Validation auc = 0.631861
Epoch 661
Validation auc = 0.632626
Epoch 662
Validation auc = 0.632244
Epoch 663
Validation auc = 0.633829
Epoch 664
Validation auc = 0.629455
Epoch 665
Loss = 5.4475e-02, PNorm = 96.7568, GNorm = 1.4666, lr_0 = 9.6744e-04
Validation auc = 0.627269
Epoch 666
Validation auc = 0.625738
Epoch 667
Validation auc = 0.623333
Epoch 668
Validation auc = 0.623879
Epoch 669
Loss = 9.5964e-03, PNorm = 96.8030, GNorm = 0.6399, lr_0 = 9.6722e-04
Loss = 1.2654e-04, PNorm = 96.8062, GNorm = 0.0047, lr_0 = 9.6720e-04
Validation auc = 0.624207
Epoch 670
Validation auc = 0.624699
Epoch 671
Validation auc = 0.620435
Epoch 672
Validation auc = 0.616390
Epoch 673
Validation auc = 0.614804
Epoch 674
Loss = 8.7132e-04, PNorm = 96.8547, GNorm = 0.0286, lr_0 = 9.6696e-04
Validation auc = 0.614312
Epoch 675
Validation auc = 0.614640
Epoch 676
Validation auc = 0.614914
Epoch 677
Validation auc = 0.615023
Epoch 678
Validation auc = 0.614804
Epoch 679
Loss = 4.1957e-03, PNorm = 96.8867, GNorm = 0.1249, lr_0 = 9.6672e-04
Validation auc = 0.614422
Epoch 680
Validation auc = 0.612891
Epoch 681
Validation auc = 0.614203
Epoch 682
Validation auc = 0.614640
Epoch 683
Loss = 5.5619e-04, PNorm = 96.9160, GNorm = 0.0113, lr_0 = 9.6648e-04
Validation auc = 0.615078
Epoch 684
Validation auc = 0.615570
Epoch 685
Validation auc = 0.616226
Epoch 686
Validation auc = 0.616171
Epoch 687
Validation auc = 0.616499
Epoch 688
Loss = 4.3576e-04, PNorm = 96.9327, GNorm = 0.0567, lr_0 = 9.6624e-04
Loss = 1.9525e-04, PNorm = 96.9336, GNorm = 0.0063, lr_0 = 9.6622e-04
Validation auc = 0.616444
Epoch 689
Validation auc = 0.616718
Epoch 690
Validation auc = 0.617374
Epoch 691
Validation auc = 0.618576
Epoch 692
Validation auc = 0.619451
Epoch 693
Loss = 2.3482e-04, PNorm = 96.9429, GNorm = 0.0065, lr_0 = 9.6600e-04
Validation auc = 0.620982
Epoch 694
Validation auc = 0.621419
Epoch 695
Validation auc = 0.621638
Epoch 696
Validation auc = 0.622021
Epoch 697
Validation auc = 0.623223
Epoch 698
Loss = 6.8004e-04, PNorm = 96.9531, GNorm = 0.0601, lr_0 = 9.6574e-04
Validation auc = 0.624590
Epoch 699
Validation auc = 0.626394
Epoch 700
Validation auc = 0.621419
Epoch 701
Validation auc = 0.616772
Epoch 702
Loss = 3.4790e-02, PNorm = 96.9617, GNorm = 0.1161, lr_0 = 9.6552e-04
Loss = 2.2636e-03, PNorm = 96.9666, GNorm = 0.0487, lr_0 = 9.6550e-04
Validation auc = 0.612782
Epoch 703
Validation auc = 0.615078
Epoch 704
Validation auc = 0.619396
Epoch 705
Validation auc = 0.626121
Epoch 706
Validation auc = 0.635961
Epoch 707
Loss = 1.8085e-02, PNorm = 97.0626, GNorm = 0.2496, lr_0 = 9.6526e-04
Loss = 7.8291e-03, PNorm = 97.0727, GNorm = 0.2039, lr_0 = 9.6525e-04
Validation auc = 0.649082
Epoch 708
Validation auc = 0.654002
Epoch 709
Validation auc = 0.652034
Epoch 710
Validation auc = 0.649464
Epoch 711
Validation auc = 0.646840
Epoch 712
Loss = 2.8343e-03, PNorm = 97.2056, GNorm = 0.0407, lr_0 = 9.6502e-04
Validation auc = 0.646895
Epoch 713
Validation auc = 0.645965
Epoch 714
Validation auc = 0.646457
Epoch 715
Validation auc = 0.647551
Epoch 716
Loss = 1.1335e-02, PNorm = 97.2896, GNorm = 0.0060, lr_0 = 9.6479e-04
Validation auc = 0.645309
Epoch 717
Validation auc = 0.643997
Epoch 718
Validation auc = 0.642685
Epoch 719
Validation auc = 0.646403
Epoch 720
Validation auc = 0.648644
Epoch 721
Loss = 4.1416e-03, PNorm = 97.3642, GNorm = 0.0595, lr_0 = 9.6455e-04
Loss = 4.9246e-05, PNorm = 97.3696, GNorm = 0.0021, lr_0 = 9.6453e-04
Validation auc = 0.652580
Epoch 722
Validation auc = 0.654384
Epoch 723
Validation auc = 0.652526
Epoch 724
Validation auc = 0.648426
Epoch 725
Validation auc = 0.640663
Epoch 726
Loss = 3.0921e-02, PNorm = 97.3998, GNorm = 1.3085, lr_0 = 9.6431e-04
Validation auc = 0.629674
Epoch 727
Validation auc = 0.643779
Epoch 728
Validation auc = 0.655751
Epoch 729
Validation auc = 0.668325
Epoch 730
Validation auc = 0.677619
Epoch 731
Loss = 4.0902e-02, PNorm = 97.6326, GNorm = 0.3919, lr_0 = 9.6405e-04
Validation auc = 0.684124
Epoch 732
Validation auc = 0.686803
Epoch 733
Validation auc = 0.687678
Epoch 734
Validation auc = 0.687842
Epoch 735
Loss = 1.0528e-01, PNorm = 97.8640, GNorm = 2.6610, lr_0 = 9.6383e-04
Loss = 2.9906e-02, PNorm = 97.8863, GNorm = 0.7235, lr_0 = 9.6381e-04
Validation auc = 0.686530
Epoch 736
Validation auc = 0.669309
Epoch 737
Validation auc = 0.666029
Epoch 738
Validation auc = 0.667013
Epoch 739
Validation auc = 0.664553
Epoch 740
Loss = 4.6665e-02, PNorm = 98.1155, GNorm = 0.1617, lr_0 = 9.6357e-04
Loss = 5.4391e-03, PNorm = 98.1298, GNorm = 0.2022, lr_0 = 9.6355e-04
Validation auc = 0.667724
Epoch 741
Validation auc = 0.680352
Epoch 742
Validation auc = 0.694129
Epoch 743
Validation auc = 0.702602
Epoch 744
Validation auc = 0.706593
Epoch 745
Loss = 5.4661e-02, PNorm = 98.3343, GNorm = 2.1818, lr_0 = 9.6333e-04
Validation auc = 0.693965
Epoch 746
Validation auc = 0.686038
Epoch 747
Validation auc = 0.682101
Epoch 748
Validation auc = 0.680133
Epoch 749
Loss = 1.9132e-02, PNorm = 98.4799, GNorm = 0.0016, lr_0 = 9.6309e-04
Validation auc = 0.680571
Epoch 750
Validation auc = 0.679149
Epoch 751
Validation auc = 0.677728
Epoch 752
Validation auc = 0.676635
Epoch 753
Validation auc = 0.674393
Epoch 754
Loss = 6.9085e-03, PNorm = 98.5778, GNorm = 0.4039, lr_0 = 9.6285e-04
Loss = 1.2376e-03, PNorm = 98.5836, GNorm = 0.0608, lr_0 = 9.6284e-04
Validation auc = 0.672261
Epoch 755
Validation auc = 0.671933
Epoch 756
Validation auc = 0.670676
Epoch 757
Validation auc = 0.670840
Epoch 758
Validation auc = 0.668981
Epoch 759
Loss = 8.3962e-04, PNorm = 98.6271, GNorm = 0.0192, lr_0 = 9.6262e-04
Validation auc = 0.667286
Epoch 760
Validation auc = 0.667396
Epoch 761
Validation auc = 0.669254
Epoch 762
Validation auc = 0.671824
Epoch 763
Validation auc = 0.675596
Epoch 764
Loss = 9.7806e-04, PNorm = 98.6655, GNorm = 0.0228, lr_0 = 9.6236e-04
Validation auc = 0.679751
Epoch 765
Validation auc = 0.682156
Epoch 766
Validation auc = 0.685108
Epoch 767
Validation auc = 0.686147
Epoch 768
Loss = 8.2580e-04, PNorm = 98.7066, GNorm = 0.0161, lr_0 = 9.6214e-04
Loss = 2.1677e-04, PNorm = 98.7088, GNorm = 0.0067, lr_0 = 9.6212e-04
Validation auc = 0.686584
Epoch 769
Validation auc = 0.681445
Epoch 770
Validation auc = 0.664717
Epoch 771
Validation auc = 0.651268
Epoch 772
Validation auc = 0.636016
Epoch 773
Loss = 4.0300e-02, PNorm = 98.8745, GNorm = 0.0798, lr_0 = 9.6188e-04
Loss = 1.2016e-04, PNorm = 98.8916, GNorm = 0.0049, lr_0 = 9.6186e-04
Validation auc = 0.629127
Epoch 774
Validation auc = 0.629729
Epoch 775
Validation auc = 0.633610
Epoch 776
Validation auc = 0.636234
Epoch 777
Validation auc = 0.650284
Epoch 778
Loss = 1.7616e-02, PNorm = 99.0787, GNorm = 0.9867, lr_0 = 9.6164e-04
Validation auc = 0.676416
Epoch 779
Validation auc = 0.686694
Epoch 780
Validation auc = 0.695222
Epoch 781
Validation auc = 0.706374
Epoch 782
Validation auc = 0.712443
Epoch 783
Loss = 2.3415e-02, PNorm = 99.4822, GNorm = 0.5558, lr_0 = 9.6139e-04
Validation auc = 0.711185
Epoch 784
Validation auc = 0.704844
Epoch 785
Validation auc = 0.698283
Epoch 786
Validation auc = 0.694675
Epoch 787
Loss = 3.9036e-03, PNorm = 99.7374, GNorm = 0.0875, lr_0 = 9.6117e-04
Loss = 2.2866e-03, PNorm = 99.7508, GNorm = 0.0666, lr_0 = 9.6115e-04
Validation auc = 0.692161
Epoch 788
Validation auc = 0.692325
Epoch 789
Validation auc = 0.695495
Epoch 790
Validation auc = 0.697627
Epoch 791
Validation auc = 0.698119
Epoch 792
Loss = 3.5041e-03, PNorm = 99.8593, GNorm = 0.0676, lr_0 = 9.6093e-04
Validation auc = 0.698611
Epoch 793
Validation auc = 0.700361
Epoch 794
Validation auc = 0.697901
Epoch 795
Validation auc = 0.695167
Epoch 796
Validation auc = 0.691395
Epoch 797
Loss = 1.0768e-02, PNorm = 99.9376, GNorm = 0.7565, lr_0 = 9.6067e-04
Validation auc = 0.691122
Epoch 798
Validation auc = 0.689591
Epoch 799
Validation auc = 0.691942
Epoch 800
Validation auc = 0.693965
Epoch 801
Loss = 1.9483e-02, PNorm = 99.9782, GNorm = 0.8578, lr_0 = 9.6045e-04
Loss = 8.4866e-03, PNorm = 99.9830, GNorm = 0.4316, lr_0 = 9.6043e-04
Validation auc = 0.696151
Epoch 802
Validation auc = 0.699650
Epoch 803
Validation auc = 0.701126
Epoch 804
Validation auc = 0.703258
Epoch 805
Validation auc = 0.703477
Epoch 806
Loss = 1.0606e-03, PNorm = 100.0395, GNorm = 0.0092, lr_0 = 9.6019e-04
Loss = 2.2051e-04, PNorm = 100.0420, GNorm = 0.0062, lr_0 = 9.6018e-04
Validation auc = 0.704844
Epoch 807
Validation auc = 0.708834
Epoch 808
Validation auc = 0.711185
Epoch 809
Validation auc = 0.713864
Epoch 810
Validation auc = 0.712169
Epoch 811
Loss = 6.5578e-02, PNorm = 100.0734, GNorm = 0.8017, lr_0 = 9.5996e-04
Validation auc = 0.707632
Epoch 812
Validation auc = 0.707522
Epoch 813
Validation auc = 0.702657
Epoch 814
Validation auc = 0.699267
Epoch 815
Validation auc = 0.676143
Epoch 816
Loss = 8.9757e-03, PNorm = 100.2299, GNorm = 0.2299, lr_0 = 9.5970e-04
Validation auc = 0.671550
Epoch 817
Validation auc = 0.668981
Epoch 818
Validation auc = 0.669200
Epoch 819
Validation auc = 0.668598
Epoch 820
Loss = 5.4931e-03, PNorm = 100.3334, GNorm = 0.0526, lr_0 = 9.5948e-04
Loss = 2.0572e-04, PNorm = 100.3396, GNorm = 0.0055, lr_0 = 9.5946e-04
Validation auc = 0.669746
Epoch 821
Validation auc = 0.670512
Epoch 822
Validation auc = 0.671550
Epoch 823
Validation auc = 0.672097
Epoch 824
Validation auc = 0.671769
Epoch 825
Loss = 7.7585e-03, PNorm = 100.3963, GNorm = 0.5704, lr_0 = 9.5924e-04
Validation auc = 0.669200
Epoch 826
Validation auc = 0.670785
Epoch 827
Validation auc = 0.670840
Epoch 828
Validation auc = 0.669418
Epoch 829
Validation auc = 0.667997
Epoch 830
Loss = 2.4476e-03, PNorm = 100.4408, GNorm = 0.0429, lr_0 = 9.5899e-04
Validation auc = 0.666302
Epoch 831
Validation auc = 0.665646
Epoch 832
Validation auc = 0.663022
Epoch 833
Validation auc = 0.662257
Epoch 834
Loss = 1.2949e-02, PNorm = 100.4651, GNorm = 0.0668, lr_0 = 9.5877e-04
Loss = 1.2258e-03, PNorm = 100.4675, GNorm = 0.0532, lr_0 = 9.5875e-04
Validation auc = 0.658594
Epoch 835
Validation auc = 0.655204
Epoch 836
Validation auc = 0.652198
Epoch 837
Validation auc = 0.649628
Epoch 838
Validation auc = 0.647442
Epoch 839
Loss = 1.9952e-03, PNorm = 100.5136, GNorm = 0.0264, lr_0 = 9.5851e-04
Loss = 1.2645e-03, PNorm = 100.5172, GNorm = 0.0368, lr_0 = 9.5849e-04
Validation auc = 0.645911
Epoch 840
Validation auc = 0.645911
Epoch 841
Validation auc = 0.644271
Epoch 842
Validation auc = 0.643615
Epoch 843
Validation auc = 0.642084
Epoch 844
Loss = 6.7330e-02, PNorm = 100.5565, GNorm = 1.8389, lr_0 = 9.5827e-04
Validation auc = 0.638859
Epoch 845
Validation auc = 0.635032
Epoch 846
Validation auc = 0.637273
Epoch 847
Validation auc = 0.640061
Epoch 848
Validation auc = 0.640171
Epoch 849
Loss = 2.7122e-04, PNorm = 100.5842, GNorm = 0.0046, lr_0 = 9.5802e-04
Validation auc = 0.640335
Epoch 850
Validation auc = 0.641045
Epoch 851
Validation auc = 0.640772
Epoch 852
Validation auc = 0.641209
Epoch 853
Loss = 4.8523e-04, PNorm = 100.6102, GNorm = 0.0083, lr_0 = 9.5780e-04
Loss = 5.7227e-04, PNorm = 100.6118, GNorm = 0.0407, lr_0 = 9.5778e-04
Validation auc = 0.641018
Epoch 854
Validation auc = 0.642193
Epoch 855
Validation auc = 0.643505
Epoch 856
Validation auc = 0.644872
Epoch 857
Validation auc = 0.646293
Epoch 858
Loss = 2.1897e-03, PNorm = 100.6319, GNorm = 0.0088, lr_0 = 9.5754e-04
Validation auc = 0.647277
Epoch 859
Validation auc = 0.648207
Epoch 860
Validation auc = 0.654330
Epoch 861
Validation auc = 0.661327
Epoch 862
Validation auc = 0.666412
Epoch 863
Loss = 7.0040e-03, PNorm = 100.6951, GNorm = 0.3893, lr_0 = 9.5730e-04
Validation auc = 0.672425
Epoch 864
Validation auc = 0.681937
Epoch 865
Validation auc = 0.688224
Epoch 866
Validation auc = 0.698994
Epoch 867
Loss = 1.4056e-02, PNorm = 100.8395, GNorm = 0.1880, lr_0 = 9.5708e-04
Loss = 1.4356e-01, PNorm = 100.8519, GNorm = 9.1206, lr_0 = 9.5707e-04
Validation auc = 0.701564
Epoch 868
Validation auc = 0.689154
Epoch 869
Validation auc = 0.682484
Epoch 870
Validation auc = 0.679149
Epoch 871
Validation auc = 0.678712
Epoch 872
Loss = 6.2301e-02, PNorm = 101.0233, GNorm = 0.1376, lr_0 = 9.5683e-04
Loss = 7.0460e-04, PNorm = 101.0318, GNorm = 0.0273, lr_0 = 9.5681e-04
Validation auc = 0.675979
Epoch 873
Validation auc = 0.688498
Epoch 874
Validation auc = 0.709873
Epoch 875
Validation auc = 0.726328
Epoch 876
Validation auc = 0.724142
Epoch 877
Loss = 2.7344e-01, PNorm = 101.2359, GNorm = 2.5056, lr_0 = 9.5659e-04
Validation auc = 0.673081
Epoch 878
Validation auc = 0.640881
Epoch 879
Validation auc = 0.618631
Epoch 880
Validation auc = 0.602887
Epoch 881
Validation auc = 0.595124
Epoch 882
Loss = 7.8490e-02, PNorm = 101.6314, GNorm = 0.5703, lr_0 = 9.5634e-04
Validation auc = 0.585666
Epoch 883
Validation auc = 0.579434
Epoch 884
Validation auc = 0.601028
Epoch 885
Validation auc = 0.620216
Epoch 886
Loss = 3.5732e-02, PNorm = 101.8766, GNorm = 0.1718, lr_0 = 9.5612e-04
Loss = 3.7537e-02, PNorm = 101.8942, GNorm = 0.6379, lr_0 = 9.5610e-04
Validation auc = 0.626722
Epoch 887
Validation auc = 0.611852
Epoch 888
Validation auc = 0.609939
Epoch 889
Validation auc = 0.598130
Epoch 890
Validation auc = 0.585010
Epoch 891
Loss = 6.0641e-02, PNorm = 102.0761, GNorm = 2.1634, lr_0 = 9.5586e-04
Validation auc = 0.591078
Epoch 892
Validation auc = 0.600044
Epoch 893
Validation auc = 0.611305
Epoch 894
Validation auc = 0.622731
Epoch 895
Validation auc = 0.629291
Epoch 896
Loss = 6.9891e-03, PNorm = 102.2510, GNorm = 0.2277, lr_0 = 9.5563e-04
Validation auc = 0.639788
Epoch 897
Validation auc = 0.649464
Epoch 898
Validation auc = 0.655150
Epoch 899
Validation auc = 0.661109
Epoch 900
Loss = 2.5676e-03, PNorm = 102.3390, GNorm = 0.0366, lr_0 = 9.5541e-04
Loss = 1.8114e-03, PNorm = 102.3436, GNorm = 0.0409, lr_0 = 9.5539e-04
Validation auc = 0.666302
Epoch 901
Validation auc = 0.669036
Epoch 902
Validation auc = 0.670730
Epoch 903
Validation auc = 0.673682
Epoch 904
Validation auc = 0.676635
Epoch 905
Loss = 2.5185e-03, PNorm = 102.4039, GNorm = 0.0395, lr_0 = 9.5515e-04
Loss = 7.6106e-04, PNorm = 102.4078, GNorm = 0.0281, lr_0 = 9.5513e-04
Validation auc = 0.678657
Epoch 906
Validation auc = 0.677509
Epoch 907
Validation auc = 0.670457
Epoch 908
Validation auc = 0.666466
Epoch 909
Validation auc = 0.660671
Epoch 910
Loss = 1.0483e-03, PNorm = 102.4535, GNorm = 0.0201, lr_0 = 9.5491e-04
Validation auc = 0.655478
Epoch 911
Validation auc = 0.653072
Epoch 912
Validation auc = 0.651487
Epoch 913
Validation auc = 0.649191
Epoch 914
Validation auc = 0.646895
Epoch 915
Loss = 3.4600e-02, PNorm = 102.4917, GNorm = 0.7128, lr_0 = 9.5466e-04
Validation auc = 0.649628
Epoch 916
Validation auc = 0.656790
Epoch 917
Validation auc = 0.672042
Epoch 918
Validation auc = 0.687896
Epoch 919
Loss = 2.0166e-02, PNorm = 102.6295, GNorm = 0.4417, lr_0 = 9.5444e-04
Loss = 3.4749e-03, PNorm = 102.6467, GNorm = 0.0983, lr_0 = 9.5442e-04
Validation auc = 0.699431
Epoch 920
Validation auc = 0.705172
Epoch 921
Validation auc = 0.710748
Epoch 922
Validation auc = 0.711568
Epoch 923
Validation auc = 0.710639
Epoch 924
Loss = 4.3361e-02, PNorm = 102.8515, GNorm = 1.5092, lr_0 = 9.5419e-04
Validation auc = 0.712333
Epoch 925
Validation auc = 0.713208
Epoch 926
Validation auc = 0.712333
Epoch 927
Validation auc = 0.711459
Epoch 928
Validation auc = 0.711240
Epoch 929
Loss = 1.3372e-03, PNorm = 103.0190, GNorm = 0.0208, lr_0 = 9.5395e-04
Validation auc = 0.710584
Epoch 930
Validation auc = 0.709928
Epoch 931
Validation auc = 0.707522
Epoch 932
Validation auc = 0.706265
Epoch 933
Loss = 6.6354e-02, PNorm = 103.1209, GNorm = 1.1435, lr_0 = 9.5371e-04
Validation auc = 0.704625
Epoch 934
Validation auc = 0.705281
Epoch 935
Validation auc = 0.703258
Epoch 936
Validation auc = 0.699759
Epoch 937
Validation auc = 0.695222
Epoch 938
Loss = 2.5135e-03, PNorm = 103.2429, GNorm = 0.1022, lr_0 = 9.5348e-04
Loss = 1.8900e-04, PNorm = 103.2505, GNorm = 0.0056, lr_0 = 9.5346e-04
Validation auc = 0.690302
Epoch 939
Validation auc = 0.686694
Epoch 940
Validation auc = 0.685819
Epoch 941
Validation auc = 0.684452
Epoch 942
Validation auc = 0.683906
Epoch 943
Loss = 8.4588e-04, PNorm = 103.3181, GNorm = 0.0200, lr_0 = 9.5324e-04
Validation auc = 0.682703
Epoch 944
Validation auc = 0.681609
Epoch 945
Validation auc = 0.682867
Epoch 946
Validation auc = 0.683304
Epoch 947
Validation auc = 0.690630
Epoch 948
Loss = 5.6066e-04, PNorm = 103.3586, GNorm = 0.0111, lr_0 = 9.5299e-04
Validation auc = 0.698502
Epoch 949
Validation auc = 0.702821
Epoch 950
Validation auc = 0.703641
Epoch 951
Validation auc = 0.705172
Epoch 952
Loss = 8.7245e-04, PNorm = 103.3867, GNorm = 0.0275, lr_0 = 9.5277e-04
Loss = 9.9970e-05, PNorm = 103.3890, GNorm = 0.0039, lr_0 = 9.5275e-04
Validation auc = 0.705828
Epoch 953
Validation auc = 0.704953
Epoch 954
Validation auc = 0.703368
Epoch 955
Validation auc = 0.702384
Epoch 956
Validation auc = 0.701290
Epoch 957
Loss = 2.4503e-04, PNorm = 103.4138, GNorm = 0.0039, lr_0 = 9.5251e-04
Loss = 5.0244e-05, PNorm = 103.4151, GNorm = 0.0015, lr_0 = 9.5250e-04
Validation auc = 0.700142
Epoch 958
Validation auc = 0.699541
Epoch 959
Validation auc = 0.698721
Epoch 960
Validation auc = 0.698229
Epoch 961
Validation auc = 0.697901
Epoch 962
Loss = 7.5112e-05, PNorm = 103.4277, GNorm = 0.0059, lr_0 = 9.5228e-04
Validation auc = 0.695769
Epoch 963
Validation auc = 0.692543
Epoch 964
Validation auc = 0.690302
Epoch 965
Validation auc = 0.697955
Epoch 966
Loss = 5.1055e-02, PNorm = 103.4439, GNorm = 0.0024, lr_0 = 9.5204e-04
Validation auc = 0.707249
Epoch 967
Validation auc = 0.709928
Epoch 968
Validation auc = 0.712333
Epoch 969
Validation auc = 0.714083
Epoch 970
Validation auc = 0.713536
Epoch 971
Loss = 1.2089e-03, PNorm = 103.4637, GNorm = 0.0151, lr_0 = 9.5180e-04
Loss = 1.6162e-03, PNorm = 103.4652, GNorm = 0.0337, lr_0 = 9.5179e-04
Validation auc = 0.713591
Epoch 972
Validation auc = 0.713645
Epoch 973
Validation auc = 0.713372
Epoch 974
Validation auc = 0.712771
Epoch 975
Validation auc = 0.711623
Epoch 976
Loss = 1.5360e-03, PNorm = 103.4880, GNorm = 0.0260, lr_0 = 9.5157e-04
Validation auc = 0.710857
Epoch 977
Validation auc = 0.709818
Epoch 978
Validation auc = 0.709764
Epoch 979
Validation auc = 0.709326
Epoch 980
Validation auc = 0.708124
Epoch 981
Loss = 1.0952e-03, PNorm = 103.5138, GNorm = 0.0303, lr_0 = 9.5132e-04
Validation auc = 0.707304
Epoch 982
Validation auc = 0.704953
Epoch 983
Validation auc = 0.703313
Epoch 984
Validation auc = 0.696206
Epoch 985
Loss = 1.0756e-03, PNorm = 103.5395, GNorm = 0.0141, lr_0 = 9.5110e-04
Loss = 2.6283e-03, PNorm = 103.5438, GNorm = 0.1842, lr_0 = 9.5108e-04
Validation auc = 0.690192
Epoch 986
Validation auc = 0.687295
Epoch 987
Validation auc = 0.685272
Epoch 988
Validation auc = 0.681664
Epoch 989
Validation auc = 0.679204
Epoch 990
Loss = 7.5054e-04, PNorm = 103.5948, GNorm = 0.0073, lr_0 = 9.5084e-04
Loss = 1.0451e-04, PNorm = 103.5972, GNorm = 0.0060, lr_0 = 9.5083e-04
Validation auc = 0.678329
Epoch 991
Validation auc = 0.677455
Epoch 992
Validation auc = 0.676908
Epoch 993
Validation auc = 0.676853
Epoch 994
Validation auc = 0.677564
Epoch 995
Loss = 2.0306e-01, PNorm = 103.6136, GNorm = 2.5999, lr_0 = 9.5061e-04
Validation auc = 0.680789
Epoch 996
Validation auc = 0.683851
Epoch 997
Validation auc = 0.685272
Epoch 998
Validation auc = 0.684999
Epoch 999
Loss = 2.0269e-03, PNorm = 103.6358, GNorm = 0.0620, lr_0 = 9.5037e-04
Validation auc = 0.683906
Epoch 1000
Validation auc = 0.682265
Epoch 1001
Validation auc = 0.681336
Epoch 1002
Validation auc = 0.679860
Epoch 1003
Validation auc = 0.678384
Epoch 1004
Loss = 4.6533e-02, PNorm = 103.6765, GNorm = 0.0183, lr_0 = 9.5014e-04
Loss = 2.1259e-03, PNorm = 103.6784, GNorm = 0.0574, lr_0 = 9.5012e-04
Validation auc = 0.678165
Epoch 1005
Validation auc = 0.678220
Epoch 1006
Validation auc = 0.678001
Epoch 1007
Validation auc = 0.677509
Epoch 1008
Validation auc = 0.677127
Epoch 1009
Loss = 2.1259e-03, PNorm = 103.7034, GNorm = 0.0401, lr_0 = 9.4990e-04
Validation auc = 0.676635
Epoch 1010
Validation auc = 0.675815
Epoch 1011
Validation auc = 0.675159
Epoch 1012
Validation auc = 0.675104
Epoch 1013
Validation auc = 0.674612
Epoch 1014
Loss = 3.3825e-03, PNorm = 103.7335, GNorm = 0.0726, lr_0 = 9.4965e-04
Validation auc = 0.675049
Epoch 1015
Validation auc = 0.674721
Epoch 1016
Validation auc = 0.673518
Epoch 1017
Validation auc = 0.675159
Epoch 1018
Loss = 4.4492e-02, PNorm = 103.7815, GNorm = 0.0423, lr_0 = 9.4943e-04
Loss = 1.2362e-04, PNorm = 103.7873, GNorm = 0.0045, lr_0 = 9.4941e-04
Validation auc = 0.679696
Epoch 1019
Validation auc = 0.684288
Epoch 1020
Validation auc = 0.683632
Epoch 1021
Validation auc = 0.682211
Epoch 1022
Validation auc = 0.681391
Epoch 1023
Loss = 9.5558e-02, PNorm = 103.8422, GNorm = 0.2821, lr_0 = 9.4918e-04
Loss = 1.9915e-02, PNorm = 103.8445, GNorm = 1.1477, lr_0 = 9.4916e-04
Validation auc = 0.674557
Epoch 1024
Validation auc = 0.668270
Epoch 1025
Validation auc = 0.664935
Epoch 1026
Validation auc = 0.662639
Epoch 1027
Validation auc = 0.662421
Epoch 1028
Loss = 8.7596e-04, PNorm = 103.8794, GNorm = 0.0216, lr_0 = 9.4894e-04
Validation auc = 0.662038
Epoch 1029
Validation auc = 0.666084
Epoch 1030
Validation auc = 0.669090
Epoch 1031
Validation auc = 0.670949
Epoch 1032
Validation auc = 0.672370
Epoch 1033
Loss = 1.3550e-03, PNorm = 103.9177, GNorm = 0.0414, lr_0 = 9.4869e-04
Validation auc = 0.676416
Epoch 1034
Validation auc = 0.678931
Epoch 1035
Validation auc = 0.678329
Epoch 1036
Validation auc = 0.677892
Epoch 1037
Loss = 1.9177e-03, PNorm = 103.9597, GNorm = 0.0493, lr_0 = 9.4847e-04
Loss = 3.9145e-04, PNorm = 103.9629, GNorm = 0.0146, lr_0 = 9.4845e-04
Validation auc = 0.677564
Epoch 1038
Validation auc = 0.677673
Epoch 1039
Validation auc = 0.677783
Epoch 1040
Validation auc = 0.677619
Epoch 1041
Validation auc = 0.674885
Epoch 1042
Loss = 1.0323e-03, PNorm = 103.9988, GNorm = 0.0367, lr_0 = 9.4823e-04
Validation auc = 0.672972
Epoch 1043
Validation auc = 0.672206
Epoch 1044
Validation auc = 0.671769
Epoch 1045
Validation auc = 0.669637
Epoch 1046
Validation auc = 0.663077
Epoch 1047
Loss = 8.6978e-02, PNorm = 104.0391, GNorm = 2.8169, lr_0 = 9.4798e-04
Validation auc = 0.651050
Epoch 1048
Validation auc = 0.628581
Epoch 1049
Validation auc = 0.609337
Epoch 1050
Validation auc = 0.596381
Epoch 1051
Loss = 1.4100e-03, PNorm = 104.2116, GNorm = 0.6920, lr_0 = 9.4776e-04
Loss = 2.1457e-05, PNorm = 104.2229, GNorm = 0.0007, lr_0 = 9.4775e-04
Validation auc = 0.594030
Epoch 1052
Validation auc = 0.600754
Epoch 1053
Validation auc = 0.601793
Epoch 1054
Validation auc = 0.600098
Epoch 1055
Validation auc = 0.600044
Epoch 1056
Loss = 7.4587e-04, PNorm = 104.3421, GNorm = 0.0336, lr_0 = 9.4751e-04
Loss = 3.7329e-05, PNorm = 104.3485, GNorm = 0.0012, lr_0 = 9.4749e-04
Validation auc = 0.599114
Epoch 1057
Validation auc = 0.597748
Epoch 1058
Validation auc = 0.596928
Epoch 1059
Validation auc = 0.590641
Epoch 1060
Validation auc = 0.627870
Epoch 1061
Loss = 3.9447e-03, PNorm = 104.4194, GNorm = 0.0883, lr_0 = 9.4728e-04
Validation auc = 0.652088
Epoch 1062
Validation auc = 0.663241
Epoch 1063
Validation auc = 0.673245
Epoch 1064
Validation auc = 0.684562
Epoch 1065
Validation auc = 0.686420
Epoch 1066
Loss = 5.6545e-04, PNorm = 104.4969, GNorm = 0.0139, lr_0 = 9.4702e-04
Validation auc = 0.689263
Epoch 1067
Validation auc = 0.691450
Epoch 1068
Validation auc = 0.693363
Epoch 1069
Validation auc = 0.693910
Epoch 1070
Loss = 3.0750e-03, PNorm = 104.5611, GNorm = 0.0792, lr_0 = 9.4681e-04
Loss = 1.8341e-04, PNorm = 104.5656, GNorm = 0.0130, lr_0 = 9.4679e-04
Validation auc = 0.695441
Epoch 1071
Validation auc = 0.696479
Epoch 1072
Validation auc = 0.695714
Epoch 1073
Validation auc = 0.695714
Epoch 1074
Validation auc = 0.695003
Epoch 1075
Loss = 1.3733e-03, PNorm = 104.6097, GNorm = 0.0544, lr_0 = 9.4657e-04
Validation auc = 0.693035
Epoch 1076
Validation auc = 0.690958
Epoch 1077
Validation auc = 0.690739
Epoch 1078
Validation auc = 0.691012
Epoch 1079
Validation auc = 0.691614
Epoch 1080
Loss = 2.0474e-03, PNorm = 104.6390, GNorm = 0.0630, lr_0 = 9.4632e-04
Validation auc = 0.692051
Epoch 1081
Validation auc = 0.691395
Epoch 1082
Validation auc = 0.691778
Epoch 1083
Validation auc = 0.691122
Epoch 1084
Loss = 2.2910e-03, PNorm = 104.6497, GNorm = 0.0147, lr_0 = 9.4610e-04
Loss = 1.7824e-03, PNorm = 104.6510, GNorm = 0.0850, lr_0 = 9.4608e-04
Validation auc = 0.691012
Epoch 1085
Validation auc = 0.691012
Epoch 1086
Validation auc = 0.691067
Epoch 1087
Validation auc = 0.691067
Epoch 1088
Validation auc = 0.690958
Epoch 1089
Loss = 2.2337e-04, PNorm = 104.6656, GNorm = 0.0043, lr_0 = 9.4585e-04
Loss = 7.0440e-03, PNorm = 104.6665, GNorm = 0.2175, lr_0 = 9.4583e-04
Validation auc = 0.691067
Epoch 1090
Validation auc = 0.690575
Epoch 1091
Validation auc = 0.690466
Epoch 1092
Validation auc = 0.690138
Epoch 1093
Validation auc = 0.690356
Epoch 1094
Loss = 1.3792e-04, PNorm = 104.6747, GNorm = 0.0032, lr_0 = 9.4561e-04
Validation auc = 0.689263
Epoch 1095
Validation auc = 0.689044
Epoch 1096
Validation auc = 0.688662
Epoch 1097
Validation auc = 0.689318
Epoch 1098
Validation auc = 0.690630
Epoch 1099
Loss = 2.3561e-02, PNorm = 104.6914, GNorm = 1.2672, lr_0 = 9.4536e-04
Validation auc = 0.691887
Epoch 1100
Validation auc = 0.691450
Epoch 1101
Validation auc = 0.693363
Epoch 1102
Validation auc = 0.694949
Epoch 1103
Loss = 6.7857e-04, PNorm = 104.7112, GNorm = 0.0182, lr_0 = 9.4515e-04
Loss = 2.5834e-04, PNorm = 104.7126, GNorm = 0.0069, lr_0 = 9.4513e-04
Validation auc = 0.695714
Epoch 1104
Validation auc = 0.696097
Epoch 1105
Validation auc = 0.696534
Epoch 1106
Validation auc = 0.696315
Epoch 1107
Validation auc = 0.696042
Epoch 1108
Loss = 3.9888e-02, PNorm = 104.7252, GNorm = 0.0075, lr_0 = 9.4489e-04
Validation auc = 0.695113
Epoch 1109
Validation auc = 0.693965
Epoch 1110
Validation auc = 0.693473
Epoch 1111
Validation auc = 0.692926
Epoch 1112
Validation auc = 0.693418
Epoch 1113
Loss = 7.5618e-03, PNorm = 104.7240, GNorm = 0.4414, lr_0 = 9.4466e-04
Validation auc = 0.693801
Epoch 1114
Validation auc = 0.693582
Epoch 1115
Validation auc = 0.694402
Epoch 1116
Validation auc = 0.694457
Epoch 1117
Loss = 6.5358e-04, PNorm = 104.7331, GNorm = 0.0084, lr_0 = 9.4444e-04
Loss = 4.7760e-05, PNorm = 104.7338, GNorm = 0.0019, lr_0 = 9.4443e-04
Validation auc = 0.694129
Epoch 1118
Validation auc = 0.693582
Epoch 1119
Validation auc = 0.692379
Epoch 1120
Validation auc = 0.691340
Epoch 1121
Validation auc = 0.690083
Epoch 1122
Loss = 7.5803e-04, PNorm = 104.7508, GNorm = 0.0137, lr_0 = 9.4419e-04
Loss = 3.5183e-04, PNorm = 104.7521, GNorm = 0.0125, lr_0 = 9.4417e-04
Validation auc = 0.689810
Epoch 1123
Validation auc = 0.689700
Epoch 1124
Validation auc = 0.687951
Epoch 1125
Validation auc = 0.686912
Epoch 1126
Validation auc = 0.687514
Epoch 1127
Loss = 1.0129e-03, PNorm = 104.7642, GNorm = 0.0326, lr_0 = 9.4396e-04
Validation auc = 0.687404
Epoch 1128
Validation auc = 0.687842
Epoch 1129
Validation auc = 0.687951
Epoch 1130
Validation auc = 0.688115
Epoch 1131
Validation auc = 0.688224
Epoch 1132
Loss = 3.3211e-04, PNorm = 104.7793, GNorm = 0.0083, lr_0 = 9.4371e-04
Validation auc = 0.689044
Epoch 1133
Validation auc = 0.688498
Epoch 1134
Validation auc = 0.688279
Epoch 1135
Validation auc = 0.688607
Epoch 1136
Loss = 2.1178e-02, PNorm = 104.7905, GNorm = 0.0040, lr_0 = 9.4349e-04
Loss = 3.8424e-05, PNorm = 104.7911, GNorm = 0.0013, lr_0 = 9.4347e-04
Validation auc = 0.685655
Epoch 1137
Validation auc = 0.684288
Epoch 1138
Validation auc = 0.683960
Epoch 1139
Validation auc = 0.683742
Epoch 1140
Validation auc = 0.684671
Epoch 1141
Loss = 2.5062e-03, PNorm = 104.8112, GNorm = 0.6864, lr_0 = 9.4324e-04
Validation auc = 0.689044
Epoch 1142
Validation auc = 0.693801
Epoch 1143
Validation auc = 0.699103
Epoch 1144
Validation auc = 0.700853
Epoch 1145
Validation auc = 0.703149
Epoch 1146
Loss = 5.5565e-04, PNorm = 104.8342, GNorm = 0.0151, lr_0 = 9.4300e-04
Validation auc = 0.704625
Epoch 1147
Validation auc = 0.706046
Epoch 1148
Validation auc = 0.707249
Epoch 1149
Validation auc = 0.707686
Epoch 1150
Loss = 1.1441e-03, PNorm = 104.8488, GNorm = 0.0307, lr_0 = 9.4279e-04
Loss = 6.4246e-05, PNorm = 104.8499, GNorm = 0.0025, lr_0 = 9.4277e-04
Validation auc = 0.707577
Epoch 1151
Validation auc = 0.707468
Epoch 1152
Validation auc = 0.707085
Epoch 1153
Validation auc = 0.706648
Epoch 1154
Validation auc = 0.706156
Epoch 1155
Loss = 2.8994e-04, PNorm = 104.8605, GNorm = 0.0112, lr_0 = 9.4253e-04
Loss = 3.2025e-05, PNorm = 104.8611, GNorm = 0.0013, lr_0 = 9.4252e-04
Validation auc = 0.705937
Epoch 1156
Validation auc = 0.705336
Epoch 1157
Validation auc = 0.710256
Epoch 1158
Validation auc = 0.713372
Epoch 1159
Validation auc = 0.706320
Epoch 1160
Loss = 3.8890e-03, PNorm = 104.8568, GNorm = 0.3872, lr_0 = 9.4230e-04
Validation auc = 0.700142
Epoch 1161
Validation auc = 0.695659
Epoch 1162
Validation auc = 0.692161
Epoch 1163
Validation auc = 0.690192
Epoch 1164
Validation auc = 0.687896
Epoch 1165
Loss = 1.7600e-01, PNorm = 104.8540, GNorm = 1.7609, lr_0 = 9.4205e-04
Validation auc = 0.675159
Epoch 1166
Validation auc = 0.663623
Epoch 1167
Validation auc = 0.654384
Epoch 1168
Validation auc = 0.647660
Epoch 1169
Loss = 2.0764e-03, PNorm = 104.8671, GNorm = 0.0902, lr_0 = 9.4183e-04
Loss = 1.3686e-03, PNorm = 104.8690, GNorm = 0.0678, lr_0 = 9.4182e-04
Validation auc = 0.643669
Epoch 1170
Validation auc = 0.644107
Epoch 1171
Validation auc = 0.647606
Epoch 1172
Validation auc = 0.649902
Epoch 1173
Validation auc = 0.651870
Epoch 1174
Loss = 7.1142e-04, PNorm = 104.8971, GNorm = 0.0284, lr_0 = 9.4158e-04
Validation auc = 0.652854
Epoch 1175
Validation auc = 0.654002
Epoch 1176
Validation auc = 0.656024
Epoch 1177
Validation auc = 0.661382
Epoch 1178
Validation auc = 0.666302
Epoch 1179
Loss = 3.7697e-02, PNorm = 104.9077, GNorm = 0.6093, lr_0 = 9.4135e-04
Validation auc = 0.665701
Epoch 1180
Validation auc = 0.664006
Epoch 1181
Validation auc = 0.660125
Epoch 1182
Validation auc = 0.656517
Epoch 1183
Loss = 1.0454e-02, PNorm = 105.0277, GNorm = 0.0176, lr_0 = 9.4112e-04
Validation auc = 0.655150
Epoch 1184
Validation auc = 0.654494
Epoch 1185
Validation auc = 0.654712
Epoch 1186
Validation auc = 0.654330
Epoch 1187
Validation auc = 0.649410
Epoch 1188
Loss = 3.3987e-02, PNorm = 105.1207, GNorm = 0.0175, lr_0 = 9.4088e-04
Loss = 2.2670e-01, PNorm = 105.1239, GNorm = 1.9527, lr_0 = 9.4087e-04
Validation auc = 0.645036
Epoch 1189
Validation auc = 0.642904
Epoch 1190
Validation auc = 0.641319
Epoch 1191
Validation auc = 0.642412
Epoch 1192
Validation auc = 0.643943
Epoch 1193
Loss = 2.3653e-03, PNorm = 105.1979, GNorm = 0.0344, lr_0 = 9.4065e-04
Validation auc = 0.644763
Epoch 1194
Validation auc = 0.645965
Epoch 1195
Validation auc = 0.646512
Epoch 1196
Validation auc = 0.645364
Epoch 1197
Validation auc = 0.643123
Epoch 1198
Loss = 7.1026e-03, PNorm = 105.2857, GNorm = 0.0459, lr_0 = 9.4040e-04
Validation auc = 0.641209
Epoch 1199
Validation auc = 0.641373
Epoch 1200
Validation auc = 0.641319
Epoch 1201
Validation auc = 0.642084
Epoch 1202
Loss = 3.7362e-03, PNorm = 105.3558, GNorm = 0.0272, lr_0 = 9.4018e-04
Loss = 4.0371e-05, PNorm = 105.3617, GNorm = 0.0011, lr_0 = 9.4016e-04
Validation auc = 0.642521
Epoch 1203
Validation auc = 0.642795
Epoch 1204
Validation auc = 0.643177
Epoch 1205
Validation auc = 0.642959
Epoch 1206
Validation auc = 0.642795
Epoch 1207
Loss = 5.7995e-04, PNorm = 105.4440, GNorm = 0.0149, lr_0 = 9.3993e-04
Loss = 1.1921e-07, PNorm = 105.4500, GNorm = 0.0000, lr_0 = 9.3991e-04
Validation auc = 0.642521
Epoch 1208
Validation auc = 0.641483
Epoch 1209
Validation auc = 0.641592
Epoch 1210
Validation auc = 0.634922
Epoch 1211
Validation auc = 0.624207
Epoch 1212
Loss = 1.1978e-03, PNorm = 105.5276, GNorm = 0.0956, lr_0 = 9.3970e-04
Validation auc = 0.616991
Epoch 1213
Validation auc = 0.612508
Epoch 1214
Validation auc = 0.637027
Epoch 1215
Validation auc = 0.640827
Epoch 1216
Loss = 4.2290e-02, PNorm = 105.6348, GNorm = 0.0025, lr_0 = 9.3946e-04
Validation auc = 0.638366
Epoch 1217
Validation auc = 0.637054
Epoch 1218
Validation auc = 0.634649
Epoch 1219
Validation auc = 0.634102
Epoch 1220
Validation auc = 0.633173
Epoch 1221
Loss = 3.2863e-03, PNorm = 105.6949, GNorm = 0.0462, lr_0 = 9.3923e-04
Loss = 2.5102e-04, PNorm = 105.6994, GNorm = 0.0100, lr_0 = 9.3922e-04
Validation auc = 0.633556
Epoch 1222
Validation auc = 0.633720
Epoch 1223
Validation auc = 0.634540
Epoch 1224
Validation auc = 0.634376
Epoch 1225
Validation auc = 0.635086
Epoch 1226
Loss = 9.6715e-03, PNorm = 105.7378, GNorm = 0.8435, lr_0 = 9.3900e-04
Validation auc = 0.634649
Epoch 1227
Validation auc = 0.633938
Epoch 1228
Validation auc = 0.633446
Epoch 1229
Validation auc = 0.633228
Epoch 1230
Validation auc = 0.632408
Epoch 1231
Loss = 2.5023e-04, PNorm = 105.7771, GNorm = 0.0045, lr_0 = 9.3875e-04
Validation auc = 0.632189
Epoch 1232
Validation auc = 0.632572
Epoch 1233
Validation auc = 0.634376
Epoch 1234
Validation auc = 0.636672
Epoch 1235
Loss = 6.0753e-03, PNorm = 105.8041, GNorm = 0.2898, lr_0 = 9.3853e-04
Loss = 2.6104e-03, PNorm = 105.8114, GNorm = 0.1414, lr_0 = 9.3852e-04
Validation auc = 0.635906
Epoch 1236
Validation auc = 0.635797
Epoch 1237
Validation auc = 0.637054
Epoch 1238
Validation auc = 0.635742
Epoch 1239
Validation auc = 0.635360
Epoch 1240
Loss = 7.8038e-04, PNorm = 105.8974, GNorm = 0.0066, lr_0 = 9.3828e-04
Loss = 1.5522e-03, PNorm = 105.9021, GNorm = 0.0258, lr_0 = 9.3827e-04
Validation auc = 0.634540
Epoch 1241
Validation auc = 0.634048
Epoch 1242
Validation auc = 0.634321
Epoch 1243
Validation auc = 0.636289
Epoch 1244
Validation auc = 0.637328
Epoch 1245
Loss = 6.1644e-04, PNorm = 105.9421, GNorm = 0.0255, lr_0 = 9.3805e-04
Validation auc = 0.637273
Epoch 1246
Validation auc = 0.636781
Epoch 1247
Validation auc = 0.636508
Epoch 1248
Validation auc = 0.636781
Epoch 1249
Loss = 4.5053e-04, PNorm = 105.9786, GNorm = 0.0018, lr_0 = 9.3782e-04
Validation auc = 0.637710
Epoch 1250
Validation auc = 0.639187
Epoch 1251
Validation auc = 0.640608
Epoch 1252
Validation auc = 0.638312
Epoch 1253
Validation auc = 0.633501
Epoch 1254
Loss = 8.6722e-05, PNorm = 106.0309, GNorm = 0.0017, lr_0 = 9.3758e-04
Loss = 1.2114e-04, PNorm = 106.0360, GNorm = 0.0036, lr_0 = 9.3757e-04
Validation auc = 0.628745
Epoch 1255
Validation auc = 0.626722
Epoch 1256
Validation auc = 0.623223
Epoch 1257
Validation auc = 0.621747
Epoch 1258
Validation auc = 0.621966
Epoch 1259
Loss = 8.0436e-04, PNorm = 106.0795, GNorm = 0.0280, lr_0 = 9.3735e-04
Validation auc = 0.622786
Epoch 1260
Validation auc = 0.631861
Epoch 1261
Validation auc = 0.645200
Epoch 1262
Validation auc = 0.650667
Epoch 1263
Validation auc = 0.654712
Epoch 1264
Loss = 1.3196e-01, PNorm = 106.1637, GNorm = 3.5016, lr_0 = 9.3710e-04
Validation auc = 0.663897
Epoch 1265
Validation auc = 0.663623
Epoch 1266
Validation auc = 0.653291
Epoch 1267
Validation auc = 0.646949
Epoch 1268
Loss = 1.0568e-01, PNorm = 106.3397, GNorm = 0.6555, lr_0 = 9.3689e-04
Loss = 8.0903e-04, PNorm = 106.3629, GNorm = 0.0367, lr_0 = 9.3687e-04
Validation auc = 0.628089
Epoch 1269
Validation auc = 0.616882
Epoch 1270
Validation auc = 0.603816
Epoch 1271
Validation auc = 0.594030
Epoch 1272
Validation auc = 0.586377
Epoch 1273
Loss = 2.8636e-02, PNorm = 106.6601, GNorm = 0.3969, lr_0 = 9.3664e-04
Loss = 7.1001e-03, PNorm = 106.6789, GNorm = 0.1362, lr_0 = 9.3662e-04
Validation auc = 0.586158
Epoch 1274
Validation auc = 0.587634
Epoch 1275
Validation auc = 0.589930
Epoch 1276
Validation auc = 0.588235
Epoch 1277
Validation auc = 0.598786
Epoch 1278
Loss = 3.4643e-02, PNorm = 106.8883, GNorm = 2.3655, lr_0 = 9.3641e-04
Validation auc = 0.621255
Epoch 1279
Validation auc = 0.633938
Epoch 1280
Validation auc = 0.637273
Epoch 1281
Validation auc = 0.636344
Epoch 1282
Validation auc = 0.639515
Epoch 1283
Loss = 1.4504e-01, PNorm = 107.2832, GNorm = 1.1576, lr_0 = 9.3616e-04
Validation auc = 0.646129
Epoch 1284
Validation auc = 0.645637
Epoch 1285
Validation auc = 0.641483
Epoch 1286
Validation auc = 0.633501
Epoch 1287
Loss = 1.0203e-02, PNorm = 107.5354, GNorm = 0.2227, lr_0 = 9.3594e-04
Loss = 5.8658e-03, PNorm = 107.5514, GNorm = 0.1343, lr_0 = 9.3592e-04
Validation auc = 0.629291
Epoch 1288
Validation auc = 0.626066
Epoch 1289
Validation auc = 0.623770
Epoch 1290
Validation auc = 0.623551
Epoch 1291
Validation auc = 0.620271
Epoch 1292
Loss = 1.4855e-02, PNorm = 107.7058, GNorm = 0.6202, lr_0 = 9.3571e-04
Validation auc = 0.615952
Epoch 1293
Validation auc = 0.613000
Epoch 1294
Validation auc = 0.610267
Epoch 1295
Validation auc = 0.607096
Epoch 1296
Validation auc = 0.603105
Epoch 1297
Loss = 6.7503e-04, PNorm = 107.8806, GNorm = 0.0139, lr_0 = 9.3546e-04
Validation auc = 0.601246
Epoch 1298
Validation auc = 0.601082
Epoch 1299
Validation auc = 0.604308
Epoch 1300
Validation auc = 0.606659
Epoch 1301
Loss = 3.7419e-03, PNorm = 107.9459, GNorm = 0.2657, lr_0 = 9.3524e-04
Loss = 6.3629e-05, PNorm = 107.9517, GNorm = 0.0037, lr_0 = 9.3523e-04
Validation auc = 0.608244
Epoch 1302
Validation auc = 0.611579
Epoch 1303
Validation auc = 0.614312
Epoch 1304
Validation auc = 0.616171
Epoch 1305
Validation auc = 0.617428
Epoch 1306
Loss = 1.8240e-03, PNorm = 108.0548, GNorm = 0.0719, lr_0 = 9.3499e-04
Loss = 8.5999e-04, PNorm = 108.0664, GNorm = 0.0348, lr_0 = 9.3498e-04
Validation auc = 0.621201
Epoch 1307
Validation auc = 0.624317
Epoch 1308
Validation auc = 0.628253
Epoch 1309
Validation auc = 0.628909
Epoch 1310
Validation auc = 0.625137
Epoch 1311
Loss = 2.1748e-02, PNorm = 108.2713, GNorm = 1.5783, lr_0 = 9.3476e-04
Validation auc = 0.629510
Epoch 1312
Validation auc = 0.634868
Epoch 1313
Validation auc = 0.643287
Epoch 1314
Validation auc = 0.638312
Epoch 1315
Validation auc = 0.634704
Epoch 1316
Loss = 2.1508e-03, PNorm = 108.4911, GNorm = 0.0880, lr_0 = 9.3451e-04
Validation auc = 0.631478
Epoch 1317
Validation auc = 0.630658
Epoch 1318
Validation auc = 0.630822
Epoch 1319
Validation auc = 0.629182
Epoch 1320
Loss = 3.2922e-03, PNorm = 108.6503, GNorm = 0.0605, lr_0 = 9.3430e-04
Loss = 3.2202e-04, PNorm = 108.6590, GNorm = 0.0167, lr_0 = 9.3428e-04
Validation auc = 0.630549
Epoch 1321
Validation auc = 0.632462
Epoch 1322
Validation auc = 0.637437
Epoch 1323
Validation auc = 0.641920
Epoch 1324
Validation auc = 0.644708
Epoch 1325
Loss = 2.2378e-02, PNorm = 108.7307, GNorm = 1.3626, lr_0 = 9.3407e-04
Validation auc = 0.643779
Epoch 1326
Validation auc = 0.640389
Epoch 1327
Validation auc = 0.637820
Epoch 1328
Validation auc = 0.636234
Epoch 1329
Validation auc = 0.638366
Epoch 1330
Loss = 6.0602e-04, PNorm = 108.7978, GNorm = 0.0184, lr_0 = 9.3382e-04
Validation auc = 0.640225
Epoch 1331
Validation auc = 0.641920
Epoch 1332
Validation auc = 0.644380
Epoch 1333
Validation auc = 0.645911
Epoch 1334
Loss = 6.5371e-03, PNorm = 108.8385, GNorm = 0.0043, lr_0 = 9.3360e-04
Loss = 6.7948e-06, PNorm = 108.8407, GNorm = 0.0004, lr_0 = 9.3359e-04
Validation auc = 0.643505
Epoch 1335
Validation auc = 0.642357
Epoch 1336
Validation auc = 0.641920
Epoch 1337
Validation auc = 0.641537
Epoch 1338
Validation auc = 0.641428
Epoch 1339
Loss = 7.5197e-04, PNorm = 108.8639, GNorm = 0.0101, lr_0 = 9.3336e-04
Loss = 1.3550e-04, PNorm = 108.8651, GNorm = 0.0051, lr_0 = 9.3334e-04
Validation auc = 0.641319
Epoch 1340
Validation auc = 0.641264
Epoch 1341
Validation auc = 0.641647
Epoch 1342
Validation auc = 0.641811
Epoch 1343
Validation auc = 0.641865
Epoch 1344
Loss = 2.7228e-04, PNorm = 108.8768, GNorm = 0.0054, lr_0 = 9.3312e-04
Validation auc = 0.641920
Epoch 1345
Validation auc = 0.645145
Epoch 1346
Validation auc = 0.649902
Epoch 1347
Validation auc = 0.650120
Epoch 1348
Validation auc = 0.649464
Epoch 1349
Loss = 2.4858e-04, PNorm = 108.9080, GNorm = 0.0075, lr_0 = 9.3288e-04
Validation auc = 0.648262
Epoch 1350
Validation auc = 0.646785
Epoch 1351
Validation auc = 0.644872
Epoch 1352
Validation auc = 0.643505
Epoch 1353
Loss = 1.2928e-02, PNorm = 108.9425, GNorm = 0.0010, lr_0 = 9.3266e-04
Loss = 4.4798e-05, PNorm = 108.9442, GNorm = 0.0018, lr_0 = 9.3264e-04
Validation auc = 0.644325
Epoch 1354
Validation auc = 0.644052
Epoch 1355
Validation auc = 0.642740
Epoch 1356
Validation auc = 0.641319
Epoch 1357
Validation auc = 0.639679
Epoch 1358
Loss = 9.0150e-04, PNorm = 108.9747, GNorm = 0.1147, lr_0 = 9.3241e-04
Validation auc = 0.638804
Epoch 1359
Validation auc = 0.639569
Epoch 1360
Validation auc = 0.639569
Epoch 1361
Validation auc = 0.640335
Epoch 1362
Validation auc = 0.640663
Epoch 1363
Loss = 1.1299e-04, PNorm = 109.0037, GNorm = 0.0027, lr_0 = 9.3218e-04
Validation auc = 0.641592
Epoch 1364
Validation auc = 0.642084
Epoch 1365
Validation auc = 0.642740
Epoch 1366
Validation auc = 0.642959
Epoch 1367
Loss = 4.4077e-04, PNorm = 109.0151, GNorm = 0.0417, lr_0 = 9.3197e-04
Loss = 5.3644e-06, PNorm = 109.0157, GNorm = 0.0002, lr_0 = 9.3195e-04
Validation auc = 0.643123
Epoch 1368
Validation auc = 0.637710
Epoch 1369
Validation auc = 0.634430
Epoch 1370
Validation auc = 0.630986
Epoch 1371
Validation auc = 0.630166
Epoch 1372
Loss = 1.5314e-03, PNorm = 109.0349, GNorm = 0.0029, lr_0 = 9.3172e-04
Loss = 4.1165e-05, PNorm = 109.0366, GNorm = 0.0032, lr_0 = 9.3170e-04
Validation auc = 0.632353
Epoch 1373
Validation auc = 0.632298
Epoch 1374
Validation auc = 0.633501
Epoch 1375
Validation auc = 0.634758
Epoch 1376
Validation auc = 0.632681
Epoch 1377
Loss = 2.9475e-04, PNorm = 109.0488, GNorm = 0.0073, lr_0 = 9.3149e-04
Validation auc = 0.630604
Epoch 1378
Validation auc = 0.630713
Epoch 1379
Validation auc = 0.635633
Epoch 1380
Validation auc = 0.637437
Epoch 1381
Validation auc = 0.646785
Epoch 1382
Loss = 9.1183e-03, PNorm = 109.0848, GNorm = 0.5765, lr_0 = 9.3124e-04
Validation auc = 0.654330
Epoch 1383
Validation auc = 0.660234
Epoch 1384
Validation auc = 0.663842
Epoch 1385
Validation auc = 0.664279
Epoch 1386
Loss = 2.6020e-02, PNorm = 109.1170, GNorm = 2.5939, lr_0 = 9.3102e-04
Loss = 4.0958e-04, PNorm = 109.1211, GNorm = 0.0297, lr_0 = 9.3101e-04
Validation auc = 0.664607
Epoch 1387
Validation auc = 0.663787
Epoch 1388
Validation auc = 0.661929
Epoch 1389
Validation auc = 0.661054
Epoch 1390
Validation auc = 0.658703
Epoch 1391
Loss = 4.5162e-04, PNorm = 109.1759, GNorm = 0.0004, lr_0 = 9.3078e-04
Validation auc = 0.657009
Epoch 1392
Validation auc = 0.656407
Epoch 1393
Validation auc = 0.655860
Epoch 1394
Validation auc = 0.655751
Epoch 1395
Validation auc = 0.656845
Epoch 1396
Loss = 1.3747e-04, PNorm = 109.2007, GNorm = 0.0032, lr_0 = 9.3055e-04
Validation auc = 0.657501
Epoch 1397
Validation auc = 0.658266
Epoch 1398
Validation auc = 0.658813
Epoch 1399
Validation auc = 0.658977
Epoch 1400
Loss = 2.2436e-03, PNorm = 109.2111, GNorm = 0.0011, lr_0 = 9.3033e-04
Loss = 1.4573e-04, PNorm = 109.2114, GNorm = 0.0068, lr_0 = 9.3032e-04
Validation auc = 0.660343
Epoch 1401
Validation auc = 0.660617
Epoch 1402
Validation auc = 0.660945
Epoch 1403
Validation auc = 0.661546
Epoch 1404
Validation auc = 0.664498
Epoch 1405
Loss = 9.8068e-04, PNorm = 109.2216, GNorm = 0.0084, lr_0 = 9.3008e-04
Loss = 1.0109e-03, PNorm = 109.2235, GNorm = 0.0403, lr_0 = 9.3007e-04
Validation auc = 0.666466
Epoch 1406
Validation auc = 0.666794
Epoch 1407
Validation auc = 0.666248
Epoch 1408
Validation auc = 0.665701
Epoch 1409
Validation auc = 0.665537
Epoch 1410
Loss = 2.8333e-04, PNorm = 109.2477, GNorm = 0.0145, lr_0 = 9.2985e-04
Validation auc = 0.664389
Epoch 1411
Validation auc = 0.664170
Epoch 1412
Validation auc = 0.663842
Epoch 1413
Validation auc = 0.663405
Epoch 1414
Validation auc = 0.662967
Epoch 1415
Loss = 2.1190e-04, PNorm = 109.2635, GNorm = 0.0060, lr_0 = 9.2961e-04
Validation auc = 0.663022
Epoch 1416
Validation auc = 0.662858
Epoch 1417
Validation auc = 0.662803
Epoch 1418
Validation auc = 0.662913
Epoch 1419
Loss = 6.4272e-05, PNorm = 109.2717, GNorm = 0.0021, lr_0 = 9.2939e-04
Loss = 1.1722e-06, PNorm = 109.2721, GNorm = 0.0001, lr_0 = 9.2938e-04
Validation auc = 0.662913
Epoch 1420
Validation auc = 0.663241
Epoch 1421
Validation auc = 0.663350
Epoch 1422
Validation auc = 0.663241
Epoch 1423
Validation auc = 0.663186
Epoch 1424
Loss = 1.4737e-04, PNorm = 109.2779, GNorm = 0.0005, lr_0 = 9.2914e-04
Validation auc = 0.663514
Epoch 1425
Validation auc = 0.663678
Epoch 1426
Validation auc = 0.663842
Epoch 1427
Validation auc = 0.664334
Epoch 1428
Validation auc = 0.664771
Epoch 1429
Loss = 7.6056e-05, PNorm = 109.2844, GNorm = 0.0019, lr_0 = 9.2891e-04
Validation auc = 0.664279
Epoch 1430
Validation auc = 0.664498
Epoch 1431
Validation auc = 0.663897
Epoch 1432
Validation auc = 0.659441
Epoch 1433
Loss = 2.4713e-05, PNorm = 109.2913, GNorm = 0.0002, lr_0 = 9.2868e-04
Validation auc = 0.657282
Epoch 1434
Validation auc = 0.656489
Epoch 1435
Validation auc = 0.656216
Epoch 1436
Validation auc = 0.655396
Epoch 1437
Validation auc = 0.656353
Epoch 1438
Loss = 6.9162e-06, PNorm = 109.2970, GNorm = 0.0005, lr_0 = 9.2845e-04
Loss = 1.1722e-06, PNorm = 109.2973, GNorm = 0.0001, lr_0 = 9.2844e-04
Validation auc = 0.657637
Epoch 1439
Validation auc = 0.658157
Epoch 1440
Validation auc = 0.659141
Epoch 1441
Validation auc = 0.659414
Epoch 1442
Validation auc = 0.659687
Epoch 1443
Loss = 1.0181e-04, PNorm = 109.3000, GNorm = 0.0078, lr_0 = 9.2822e-04
Validation auc = 0.658102
Epoch 1444
Validation auc = 0.656435
Epoch 1445
Validation auc = 0.655724
Epoch 1446
Validation auc = 0.655286
Epoch 1447
Validation auc = 0.655642
Epoch 1448
Loss = 1.5449e-06, PNorm = 109.3018, GNorm = 0.0001, lr_0 = 9.2798e-04
Validation auc = 0.656271
Epoch 1449
Validation auc = 0.656790
Epoch 1450
Validation auc = 0.657938
Epoch 1451
Validation auc = 0.657829
Epoch 1452
Loss = 9.2124e-06, PNorm = 109.3028, GNorm = 0.0000, lr_0 = 9.2776e-04
Loss = 1.8080e-06, PNorm = 109.3028, GNorm = 0.0001, lr_0 = 9.2775e-04
Validation auc = 0.658239
Epoch 1453
Validation auc = 0.658485
Epoch 1454
Validation auc = 0.657665
Epoch 1455
Validation auc = 0.656517
Epoch 1456
Validation auc = 0.655450
Epoch 1457
Loss = 8.0823e-07, PNorm = 109.3038, GNorm = 0.0001, lr_0 = 9.2752e-04
Loss = 2.1933e-05, PNorm = 109.3039, GNorm = 0.0039, lr_0 = 9.2750e-04
Validation auc = 0.654794
Epoch 1458
Validation auc = 0.654986
Epoch 1459
Validation auc = 0.655696
Epoch 1460
Validation auc = 0.656134
Epoch 1461
Validation auc = 0.656571
Epoch 1462
Loss = 2.6392e-06, PNorm = 109.3044, GNorm = 0.0003, lr_0 = 9.2729e-04
Validation auc = 0.656790
Epoch 1463
Validation auc = 0.656954
Epoch 1464
Validation auc = 0.656845
Epoch 1465
Validation auc = 0.656899
Epoch 1466
Loss = 1.5933e-06, PNorm = 109.3050, GNorm = 0.0000, lr_0 = 9.2706e-04
Validation auc = 0.657036
Epoch 1467
Validation auc = 0.657200
Epoch 1468
Validation auc = 0.656735
Epoch 1469
Validation auc = 0.657610
Epoch 1470
Validation auc = 0.656954
Epoch 1471
Loss = 3.7812e-06, PNorm = 109.3072, GNorm = 0.0002, lr_0 = 9.2683e-04
Loss = 1.7881e-06, PNorm = 109.3075, GNorm = 0.0002, lr_0 = 9.2681e-04
Validation auc = 0.657091
Epoch 1472
Validation auc = 0.656271
Epoch 1473
Validation auc = 0.656298
Epoch 1474
Validation auc = 0.656271
Epoch 1475
Validation auc = 0.655888
Epoch 1476
Loss = 4.0696e-05, PNorm = 109.3108, GNorm = 0.0026, lr_0 = 9.2660e-04
Validation auc = 0.655669
Epoch 1477
Validation auc = 0.655286
Epoch 1478
Validation auc = 0.655314
Epoch 1479
Validation auc = 0.654084
Epoch 1480
Validation auc = 0.652444
Epoch 1481
Loss = 2.4749e-03, PNorm = 109.3204, GNorm = 0.3671, lr_0 = 9.2635e-04
Validation auc = 0.653564
Epoch 1482
Validation auc = 0.652635
Epoch 1483
Validation auc = 0.652526
Epoch 1484
Validation auc = 0.651022
Epoch 1485
Loss = 9.3469e-05, PNorm = 109.3397, GNorm = 0.0002, lr_0 = 9.2614e-04
Loss = 8.1459e-07, PNorm = 109.3407, GNorm = 0.0001, lr_0 = 9.2612e-04
Validation auc = 0.650585
Epoch 1486
Validation auc = 0.650011
Epoch 1487
Validation auc = 0.649956
Epoch 1488
Validation auc = 0.649792
Epoch 1489
Validation auc = 0.649738
Epoch 1490
Loss = 6.9632e-05, PNorm = 109.3492, GNorm = 0.0071, lr_0 = 9.2589e-04
Loss = 3.3714e-05, PNorm = 109.3497, GNorm = 0.0018, lr_0 = 9.2587e-04
Validation auc = 0.649656
Epoch 1491
Validation auc = 0.649820
Epoch 1492
Validation auc = 0.649710
Epoch 1493
Validation auc = 0.649601
Epoch 1494
Validation auc = 0.649492
Epoch 1495
Loss = 4.4701e-06, PNorm = 109.3536, GNorm = 0.0002, lr_0 = 9.2566e-04
Validation auc = 0.649574
Epoch 1496
Validation auc = 0.650640
Epoch 1497
Validation auc = 0.650530
Epoch 1498
Validation auc = 0.650421
Epoch 1499
Loss = 2.0662e-05, PNorm = 109.3574, GNorm = 0.0000, lr_0 = 9.2543e-04
Validation auc = 0.650284
Epoch 1500
Validation auc = 0.650558
Epoch 1501
Validation auc = 0.650640
Epoch 1502
Validation auc = 0.650558
Epoch 1503
Validation auc = 0.650612
Epoch 1504
Loss = 2.1433e-06, PNorm = 109.3594, GNorm = 0.0002, lr_0 = 9.2520e-04
Loss = 5.6028e-06, PNorm = 109.3595, GNorm = 0.0003, lr_0 = 9.2518e-04
Validation auc = 0.650776
Epoch 1505
Validation auc = 0.651706
Epoch 1506
Validation auc = 0.652088
Epoch 1507
Validation auc = 0.652006
Epoch 1508
Validation auc = 0.652608
Epoch 1509
Loss = 5.2929e-07, PNorm = 109.3660, GNorm = 0.0000, lr_0 = 9.2497e-04
Validation auc = 0.653100
Epoch 1510
Validation auc = 0.653264
Epoch 1511
Validation auc = 0.653592
Epoch 1512
Validation auc = 0.653865
Epoch 1513
Validation auc = 0.653865
Epoch 1514
Loss = 6.8001e-05, PNorm = 109.3692, GNorm = 0.0041, lr_0 = 9.2472e-04
Validation auc = 0.654029
Epoch 1515
Validation auc = 0.654248
Epoch 1516
Validation auc = 0.653865
Epoch 1517
Validation auc = 0.653373
Epoch 1518
Loss = 1.3911e-06, PNorm = 109.3710, GNorm = 0.0001, lr_0 = 9.2451e-04
Loss = 9.9341e-08, PNorm = 109.3711, GNorm = 0.0000, lr_0 = 9.2449e-04
Validation auc = 0.653154
Epoch 1519
Validation auc = 0.652990
Epoch 1520
Validation auc = 0.652990
Epoch 1521
Validation auc = 0.649410
Epoch 1522
Validation auc = 0.644872
Epoch 1523
Loss = 2.1077e-05, PNorm = 109.3760, GNorm = 0.0031, lr_0 = 9.2427e-04
Loss = 0.0000e+00, PNorm = 109.3767, GNorm = 0.0000, lr_0 = 9.2425e-04
Validation auc = 0.641073
Epoch 1524
Validation auc = 0.636207
Epoch 1525
Validation auc = 0.636508
Epoch 1526
Validation auc = 0.641537
Epoch 1527
Validation auc = 0.642084
Epoch 1528
Loss = 8.3416e-05, PNorm = 109.3896, GNorm = 0.0156, lr_0 = 9.2404e-04
Validation auc = 0.642521
Epoch 1529
Validation auc = 0.642193
Epoch 1530
Validation auc = 0.641592
Epoch 1531
Validation auc = 0.641975
Epoch 1532
Validation auc = 0.641756
Epoch 1533
Loss = 2.6562e-05, PNorm = 109.3974, GNorm = 0.0020, lr_0 = 9.2379e-04
Validation auc = 0.641592
Epoch 1534
Validation auc = 0.641264
Epoch 1535
Validation auc = 0.641100
Epoch 1536
Validation auc = 0.641100
Epoch 1537
Loss = 3.2544e-07, PNorm = 109.3992, GNorm = 0.0000, lr_0 = 9.2358e-04
Loss = 0.0000e+00, PNorm = 109.3993, GNorm = 0.0000, lr_0 = 9.2356e-04
Validation auc = 0.641045
Epoch 1538
Validation auc = 0.640991
Epoch 1539
Validation auc = 0.640991
Epoch 1540
Validation auc = 0.640936
Epoch 1541
Validation auc = 0.640936
Epoch 1542
Loss = 1.0836e-05, PNorm = 109.4000, GNorm = 0.0005, lr_0 = 9.2335e-04
Validation auc = 0.641045
Epoch 1543
Validation auc = 0.640936
Epoch 1544
Validation auc = 0.640881
Epoch 1545
Validation auc = 0.640827
Epoch 1546
Validation auc = 0.640881
Epoch 1547
Loss = 1.5711e-06, PNorm = 109.4006, GNorm = 0.0002, lr_0 = 9.2310e-04
Validation auc = 0.640827
Epoch 1548
Validation auc = 0.640827
Epoch 1549
Validation auc = 0.640772
Epoch 1550
Validation auc = 0.640827
Epoch 1551
Loss = 8.3803e-07, PNorm = 109.4009, GNorm = 0.0000, lr_0 = 9.2289e-04
Loss = 3.1789e-07, PNorm = 109.4009, GNorm = 0.0000, lr_0 = 9.2287e-04
Validation auc = 0.640881
Epoch 1552
Validation auc = 0.640881
Epoch 1553
Validation auc = 0.640936
Epoch 1554
Validation auc = 0.640991
Epoch 1555
Validation auc = 0.640827
Epoch 1556
Loss = 1.2934e-06, PNorm = 109.4011, GNorm = 0.0002, lr_0 = 9.2264e-04
Loss = 1.9669e-06, PNorm = 109.4011, GNorm = 0.0001, lr_0 = 9.2263e-04
Validation auc = 0.640827
Epoch 1557
Validation auc = 0.640827
Epoch 1558
Validation auc = 0.640827
Epoch 1559
Validation auc = 0.640827
Epoch 1560
Validation auc = 0.640827
Epoch 1561
Loss = 2.9134e-06, PNorm = 109.4013, GNorm = 0.0001, lr_0 = 9.2242e-04
Validation auc = 0.640881
Epoch 1562
Validation auc = 0.640881
Epoch 1563
Validation auc = 0.640881
Epoch 1564
Validation auc = 0.640881
Epoch 1565
Validation auc = 0.640936
Epoch 1566
Loss = 2.5749e-07, PNorm = 109.4015, GNorm = 0.0000, lr_0 = 9.2217e-04
Validation auc = 0.640936
Epoch 1567
Validation auc = 0.640991
Epoch 1568
Validation auc = 0.640772
Epoch 1569
Validation auc = 0.640663
Epoch 1570
Loss = 4.2600e-06, PNorm = 109.4019, GNorm = 0.0000, lr_0 = 9.2196e-04
Loss = 5.9605e-08, PNorm = 109.4019, GNorm = 0.0000, lr_0 = 9.2194e-04
Validation auc = 0.640608
Epoch 1571
Validation auc = 0.640663
Epoch 1572
Validation auc = 0.640608
Epoch 1573
Validation auc = 0.640499
Epoch 1574
Validation auc = 0.640444
Epoch 1575
Loss = 3.1707e-06, PNorm = 109.4022, GNorm = 0.0002, lr_0 = 9.2173e-04
Validation auc = 0.640444
Epoch 1576
Validation auc = 0.640007
Epoch 1577
Validation auc = 0.641100
Epoch 1578
Validation auc = 0.641592
Epoch 1579
Validation auc = 0.641920
Epoch 1580
Loss = 2.2482e-06, PNorm = 109.4053, GNorm = 0.0001, lr_0 = 9.2148e-04
Validation auc = 0.641592
Epoch 1581
Validation auc = 0.641756
Epoch 1582
Validation auc = 0.641209
Epoch 1583
Validation auc = 0.641319
Epoch 1584
Loss = 5.9876e-06, PNorm = 109.4084, GNorm = 0.0002, lr_0 = 9.2127e-04
Loss = 2.7815e-07, PNorm = 109.4085, GNorm = 0.0000, lr_0 = 9.2125e-04
Validation auc = 0.641483
Epoch 1585
Validation auc = 0.641537
Epoch 1586
Validation auc = 0.641592
Epoch 1587
Validation auc = 0.641592
Epoch 1588
Validation auc = 0.641483
Epoch 1589
Loss = 1.5238e-05, PNorm = 109.4102, GNorm = 0.0014, lr_0 = 9.2103e-04
Loss = 1.9868e-08, PNorm = 109.4103, GNorm = 0.0000, lr_0 = 9.2101e-04
Validation auc = 0.641428
Epoch 1590
Validation auc = 0.641319
Epoch 1591
Validation auc = 0.641428
Epoch 1592
Validation auc = 0.641647
Epoch 1593
Validation auc = 0.641647
Epoch 1594
Loss = 4.7277e-06, PNorm = 109.4120, GNorm = 0.0002, lr_0 = 9.2080e-04
Validation auc = 0.641647
Epoch 1595
Validation auc = 0.641701
Epoch 1596
Validation auc = 0.641865
Epoch 1597
Validation auc = 0.642029
Epoch 1598
Validation auc = 0.642029
Epoch 1599
Loss = 2.5964e-06, PNorm = 109.4137, GNorm = 0.0001, lr_0 = 9.2055e-04
Validation auc = 0.641920
Epoch 1600
Validation auc = 0.641756
Epoch 1601
Validation auc = 0.641756
Epoch 1602
Validation auc = 0.641811
Epoch 1603
Loss = 2.3042e-06, PNorm = 109.4147, GNorm = 0.0001, lr_0 = 9.2034e-04
Loss = 3.4430e-05, PNorm = 109.4148, GNorm = 0.0034, lr_0 = 9.2032e-04
Validation auc = 0.641701
Epoch 1604
Validation auc = 0.641811
Epoch 1605
Validation auc = 0.641592
Epoch 1606
Validation auc = 0.641537
Epoch 1607
Validation auc = 0.641483
Epoch 1608
Loss = 7.4405e-06, PNorm = 109.4158, GNorm = 0.0002, lr_0 = 9.2010e-04
Validation auc = 0.641483
Epoch 1609
Validation auc = 0.641264
Epoch 1610
Validation auc = 0.641319
Epoch 1611
Validation auc = 0.641319
Epoch 1612
Validation auc = 0.641319
Epoch 1613
Loss = 5.4166e-06, PNorm = 109.4167, GNorm = 0.0002, lr_0 = 9.1987e-04
Validation auc = 0.641264
Epoch 1614
Validation auc = 0.641264
Epoch 1615
Validation auc = 0.641209
Epoch 1616
Validation auc = 0.641264
Epoch 1617
Loss = 9.2625e-07, PNorm = 109.4175, GNorm = 0.0001, lr_0 = 9.1966e-04
Loss = 1.8279e-06, PNorm = 109.4176, GNorm = 0.0001, lr_0 = 9.1964e-04
Validation auc = 0.641264
Epoch 1618
Validation auc = 0.641264
Epoch 1619
Validation auc = 0.641264
Epoch 1620
Validation auc = 0.641264
Epoch 1621
Validation auc = 0.641264
Epoch 1622
Loss = 6.9893e-04, PNorm = 109.4190, GNorm = 0.0012, lr_0 = 9.1941e-04
Loss = 4.1723e-07, PNorm = 109.4195, GNorm = 0.0000, lr_0 = 9.1939e-04
Validation auc = 0.642029
Epoch 1623
Validation auc = 0.643232
Epoch 1624
Validation auc = 0.643833
Epoch 1625
Validation auc = 0.644161
Epoch 1626
Validation auc = 0.645091
Epoch 1627
Loss = 9.4480e-06, PNorm = 109.4253, GNorm = 0.0005, lr_0 = 9.1918e-04
Validation auc = 0.645091
Epoch 1628
Validation auc = 0.645364
Epoch 1629
Validation auc = 0.645692
Epoch 1630
Validation auc = 0.645801
Epoch 1631
Validation auc = 0.645637
Epoch 1632
Loss = 3.1631e-04, PNorm = 109.4287, GNorm = 0.0232, lr_0 = 9.1894e-04
Validation auc = 0.645856
Epoch 1633
Validation auc = 0.646129
Epoch 1634
Validation auc = 0.646239
Epoch 1635
Validation auc = 0.646457
Epoch 1636
Loss = 1.9877e-04, PNorm = 109.4320, GNorm = 0.0471, lr_0 = 9.1873e-04
Loss = 3.9736e-08, PNorm = 109.4323, GNorm = 0.0000, lr_0 = 9.1871e-04
Validation auc = 0.645965
Epoch 1637
Validation auc = 0.645747
Epoch 1638
Validation auc = 0.645473
Epoch 1639
Validation auc = 0.645583
Epoch 1640
Validation auc = 0.645528
Epoch 1641
Loss = 9.1479e-05, PNorm = 109.4360, GNorm = 0.0348, lr_0 = 9.1848e-04
Validation auc = 0.645473
Epoch 1642
Validation auc = 0.645747
Epoch 1643
Validation auc = 0.645911
Epoch 1644
Validation auc = 0.645965
Epoch 1645
Validation auc = 0.646020
Epoch 1646
Loss = 4.6560e-06, PNorm = 109.4384, GNorm = 0.0003, lr_0 = 9.1825e-04
Validation auc = 0.646075
Epoch 1647
Validation auc = 0.646184
Epoch 1648
Validation auc = 0.646184
Epoch 1649
Validation auc = 0.645692
Epoch 1650
Loss = 9.4212e-06, PNorm = 109.4402, GNorm = 0.0005, lr_0 = 9.1804e-04
Loss = 7.1525e-07, PNorm = 109.4404, GNorm = 0.0000, lr_0 = 9.1803e-04
Validation auc = 0.645036
Epoch 1651
Validation auc = 0.644161
Epoch 1652
Validation auc = 0.643833
Epoch 1653
Validation auc = 0.638120
Epoch 1654
Validation auc = 0.637902
Epoch 1655
Loss = 2.6809e-06, PNorm = 109.4429, GNorm = 0.0001, lr_0 = 9.1780e-04
Loss = 2.3842e-07, PNorm = 109.4430, GNorm = 0.0000, lr_0 = 9.1778e-04
Validation auc = 0.637738
Epoch 1656
Validation auc = 0.637601
Epoch 1657
Validation auc = 0.637601
Epoch 1658
Validation auc = 0.637546
Epoch 1659
Validation auc = 0.637546
Epoch 1660
Loss = 4.3485e-06, PNorm = 109.4443, GNorm = 0.0002, lr_0 = 9.1757e-04
Validation auc = 0.637546
Epoch 1661
Validation auc = 0.637574
Epoch 1662
Validation auc = 0.637464
Epoch 1663
Validation auc = 0.631861
Epoch 1664
Validation auc = 0.631861
Epoch 1665
Loss = 3.5117e-06, PNorm = 109.4456, GNorm = 0.0003, lr_0 = 9.1733e-04
Validation auc = 0.631861
Epoch 1666
Validation auc = 0.631752
Epoch 1667
Validation auc = 0.631697
Epoch 1668
Validation auc = 0.631752
Epoch 1669
Loss = 2.1755e-06, PNorm = 109.4467, GNorm = 0.0000, lr_0 = 9.1712e-04
Loss = 3.8941e-06, PNorm = 109.4468, GNorm = 0.0003, lr_0 = 9.1710e-04
Validation auc = 0.631752
Epoch 1670
Validation auc = 0.631752
Epoch 1671
Validation auc = 0.631752
Epoch 1672
Validation auc = 0.631752
Epoch 1673
Validation auc = 0.631806
Epoch 1674
Loss = 2.9551e-06, PNorm = 109.4488, GNorm = 0.0002, lr_0 = 9.1687e-04
Validation auc = 0.631752
Epoch 1675
Validation auc = 0.631697
Epoch 1676
Validation auc = 0.631588
Epoch 1677
Validation auc = 0.631806
Epoch 1678
Validation auc = 0.643287
Epoch 1679
Loss = 2.8372e-07, PNorm = 109.4561, GNorm = 0.0000, lr_0 = 9.1664e-04
Validation auc = 0.644927
Epoch 1680
Validation auc = 0.645473
Epoch 1681
Validation auc = 0.645856
Epoch 1682
Validation auc = 0.645692
Epoch 1683
Loss = 1.4659e-05, PNorm = 109.4671, GNorm = 0.0000, lr_0 = 9.1642e-04
Validation auc = 0.645528
Epoch 1684
Validation auc = 0.645637
Epoch 1685
Validation auc = 0.646020
Epoch 1686
Validation auc = 0.646020
Epoch 1687
Validation auc = 0.646239
Epoch 1688
Loss = 5.8480e-05, PNorm = 109.4709, GNorm = 0.0059, lr_0 = 9.1619e-04
Loss = 1.2318e-06, PNorm = 109.4711, GNorm = 0.0001, lr_0 = 9.1617e-04
Validation auc = 0.646348
Epoch 1689
Validation auc = 0.646403
Epoch 1690
Validation auc = 0.646567
Epoch 1691
Validation auc = 0.646621
Epoch 1692
Validation auc = 0.646567
Epoch 1693
Loss = 3.1995e-06, PNorm = 109.4731, GNorm = 0.0002, lr_0 = 9.1596e-04
Validation auc = 0.646457
Epoch 1694
Validation auc = 0.646457
Epoch 1695
Validation auc = 0.646457
Epoch 1696
Validation auc = 0.646457
Epoch 1697
Validation auc = 0.646457
Epoch 1698
Loss = 1.4400e-06, PNorm = 109.4746, GNorm = 0.0001, lr_0 = 9.1572e-04
Validation auc = 0.646403
Epoch 1699
Validation auc = 0.646403
Epoch 1700
Validation auc = 0.646293
Epoch 1701
Validation auc = 0.646293
Epoch 1702
Loss = 1.9655e-05, PNorm = 109.4759, GNorm = 0.0040, lr_0 = 9.1551e-04
Loss = 9.9341e-08, PNorm = 109.4761, GNorm = 0.0000, lr_0 = 9.1549e-04
Validation auc = 0.646239
Epoch 1703
Validation auc = 0.646239
Epoch 1704
Validation auc = 0.646239
Epoch 1705
Validation auc = 0.646239
Epoch 1706
Validation auc = 0.646239
Epoch 1707
Loss = 1.6999e-04, PNorm = 109.4777, GNorm = 0.0496, lr_0 = 9.1526e-04
Loss = 2.3842e-07, PNorm = 109.4777, GNorm = 0.0000, lr_0 = 9.1525e-04
Validation auc = 0.646075
Epoch 1708
Validation auc = 0.646239
Epoch 1709
Validation auc = 0.646293
Epoch 1710
Validation auc = 0.646403
Epoch 1711
Validation auc = 0.646348
Epoch 1712
Loss = 1.0119e-05, PNorm = 109.4787, GNorm = 0.0005, lr_0 = 9.1504e-04
Validation auc = 0.646403
Epoch 1713
Validation auc = 0.646512
Epoch 1714
Validation auc = 0.646457
Epoch 1715
Validation auc = 0.646567
Epoch 1716
Loss = 3.1667e-06, PNorm = 109.4798, GNorm = 0.0000, lr_0 = 9.1481e-04
Validation auc = 0.646567
Epoch 1717
Validation auc = 0.646512
Epoch 1718
Validation auc = 0.646512
Epoch 1719
Validation auc = 0.646567
Epoch 1720
Validation auc = 0.646567
Epoch 1721
Loss = 2.0146e-06, PNorm = 109.4810, GNorm = 0.0001, lr_0 = 9.1458e-04
Loss = 1.4106e-06, PNorm = 109.4811, GNorm = 0.0001, lr_0 = 9.1457e-04
Validation auc = 0.646567
Epoch 1722
Validation auc = 0.646567
Epoch 1723
Validation auc = 0.646676
Epoch 1724
Validation auc = 0.646676
Epoch 1725
Validation auc = 0.646676
Epoch 1726
Loss = 1.2135e-06, PNorm = 109.4820, GNorm = 0.0001, lr_0 = 9.1436e-04
Validation auc = 0.646785
Epoch 1727
Validation auc = 0.646840
Epoch 1728
Validation auc = 0.646895
Epoch 1729
Validation auc = 0.646840
Epoch 1730
Validation auc = 0.646785
Epoch 1731
Loss = 1.6498e-06, PNorm = 109.4838, GNorm = 0.0001, lr_0 = 9.1411e-04
Validation auc = 0.647004
Epoch 1732
Validation auc = 0.646949
Epoch 1733
Validation auc = 0.646949
Epoch 1734
Validation auc = 0.647004
Epoch 1735
Loss = 2.7917e-06, PNorm = 109.4848, GNorm = 0.0002, lr_0 = 9.1390e-04
Loss = 2.4438e-06, PNorm = 109.4849, GNorm = 0.0002, lr_0 = 9.1389e-04
Validation auc = 0.647059
Epoch 1736
Validation auc = 0.647442
Epoch 1737
Validation auc = 0.647496
Epoch 1738
Validation auc = 0.647551
Epoch 1739
Validation auc = 0.647824
Epoch 1740
Loss = 2.8849e-07, PNorm = 109.4893, GNorm = 0.0000, lr_0 = 9.1366e-04
Loss = 3.9736e-08, PNorm = 109.4895, GNorm = 0.0000, lr_0 = 9.1364e-04
Validation auc = 0.647770
Epoch 1741
Validation auc = 0.647715
Epoch 1742
Validation auc = 0.647606
Epoch 1743
Validation auc = 0.647442
Epoch 1744
Validation auc = 0.647442
Epoch 1745
Loss = 5.3644e-07, PNorm = 109.4914, GNorm = 0.0000, lr_0 = 9.1343e-04
Validation auc = 0.647551
Epoch 1746
Validation auc = 0.647551
Epoch 1747
Validation auc = 0.647496
Epoch 1748
Validation auc = 0.647551
Epoch 1749
Loss = 5.6505e-07, PNorm = 109.4925, GNorm = 0.0000, lr_0 = 9.1320e-04
Validation auc = 0.647606
Epoch 1750
Validation auc = 0.647606
Epoch 1751
Validation auc = 0.647606
Epoch 1752
Validation auc = 0.647551
Epoch 1753
Validation auc = 0.647551
Epoch 1754
Loss = 5.5909e-07, PNorm = 109.4933, GNorm = 0.0000, lr_0 = 9.1298e-04
Loss = 5.9605e-08, PNorm = 109.4933, GNorm = 0.0000, lr_0 = 9.1296e-04
Validation auc = 0.647551
Epoch 1755
Validation auc = 0.647551
Epoch 1756
Validation auc = 0.647606
Epoch 1757
Validation auc = 0.647496
Epoch 1758
Validation auc = 0.647442
Epoch 1759
Loss = 1.5998e-06, PNorm = 109.4944, GNorm = 0.0001, lr_0 = 9.1275e-04
Validation auc = 0.647442
Epoch 1760
Validation auc = 0.647496
Epoch 1761
Validation auc = 0.647551
Epoch 1762
Validation auc = 0.647606
Epoch 1763
Validation auc = 0.647551
Epoch 1764
Loss = 3.7670e-07, PNorm = 109.4961, GNorm = 0.0000, lr_0 = 9.1251e-04
Validation auc = 0.647551
Epoch 1765
Validation auc = 0.647606
Epoch 1766
Validation auc = 0.647606
Epoch 1767
Validation auc = 0.647551
Epoch 1768
Loss = 1.7140e-05, PNorm = 109.4971, GNorm = 0.0006, lr_0 = 9.1230e-04
Loss = 1.9868e-08, PNorm = 109.4972, GNorm = 0.0000, lr_0 = 9.1228e-04
Validation auc = 0.647606
Epoch 1769
Validation auc = 0.647824
Epoch 1770
Validation auc = 0.647824
Epoch 1771
Validation auc = 0.647879
Epoch 1772
Validation auc = 0.647824
Epoch 1773
Loss = 3.3125e-06, PNorm = 109.4980, GNorm = 0.0005, lr_0 = 9.1206e-04
Loss = 2.3842e-07, PNorm = 109.4980, GNorm = 0.0000, lr_0 = 9.1204e-04
Validation auc = 0.647879
Epoch 1774
Validation auc = 0.647770
Epoch 1775
Validation auc = 0.647879
Epoch 1776
Validation auc = 0.647934
Epoch 1777
Validation auc = 0.647988
Epoch 1778
Loss = 4.8824e-06, PNorm = 109.4993, GNorm = 0.0002, lr_0 = 9.1183e-04
Validation auc = 0.648098
Epoch 1779
Validation auc = 0.648043
Epoch 1780
Validation auc = 0.648043
Epoch 1781
Validation auc = 0.648043
Epoch 1782
Validation auc = 0.648043
Epoch 1783
Loss = 5.2214e-07, PNorm = 109.5016, GNorm = 0.0000, lr_0 = 9.1159e-04
Validation auc = 0.648043
Epoch 1784
Validation auc = 0.648043
Epoch 1785
Validation auc = 0.648043
Epoch 1786
Validation auc = 0.648043
Epoch 1787
Loss = 1.6057e-06, PNorm = 109.5028, GNorm = 0.0001, lr_0 = 9.1138e-04
Loss = 0.0000e+00, PNorm = 109.5029, GNorm = 0.0000, lr_0 = 9.1136e-04
Validation auc = 0.648043
Epoch 1788
Validation auc = 0.648043
Epoch 1789
Validation auc = 0.647988
Epoch 1790
Validation auc = 0.647988
Epoch 1791
Validation auc = 0.647934
Epoch 1792
Loss = 1.5139e-06, PNorm = 109.5037, GNorm = 0.0002, lr_0 = 9.1115e-04
Validation auc = 0.647879
Epoch 1793
Validation auc = 0.647879
Epoch 1794
Validation auc = 0.647879
Epoch 1795
Validation auc = 0.647879
Epoch 1796
Validation auc = 0.647879
Epoch 1797
Loss = 8.2884e-06, PNorm = 109.5045, GNorm = 0.0007, lr_0 = 9.1091e-04
Validation auc = 0.647879
Epoch 1798
Validation auc = 0.647824
Epoch 1799
Validation auc = 0.647824
Epoch 1800
Validation auc = 0.647824
Epoch 1801
Loss = 1.6092e-06, PNorm = 109.5051, GNorm = 0.0000, lr_0 = 9.1070e-04
Loss = 9.9341e-08, PNorm = 109.5051, GNorm = 0.0000, lr_0 = 9.1068e-04
Validation auc = 0.647824
Epoch 1802
Validation auc = 0.647824
Epoch 1803
Validation auc = 0.647824
Epoch 1804
Validation auc = 0.647824
Epoch 1805
Validation auc = 0.648262
Epoch 1806
Loss = 3.3973e-06, PNorm = 109.5113, GNorm = 0.0001, lr_0 = 9.1046e-04
Loss = 1.7881e-07, PNorm = 109.5125, GNorm = 0.0000, lr_0 = 9.1044e-04
Validation auc = 0.648754
Epoch 1807
Validation auc = 0.648262
Epoch 1808
Validation auc = 0.648480
Epoch 1809
Validation auc = 0.648644
Epoch 1810
Validation auc = 0.648863
Epoch 1811
Loss = 6.1483e-06, PNorm = 109.5218, GNorm = 0.0010, lr_0 = 9.1023e-04
Validation auc = 0.648918
Epoch 1812
Validation auc = 0.648863
Epoch 1813
Validation auc = 0.648699
Epoch 1814
Validation auc = 0.649082
Epoch 1815
Validation auc = 0.649082
Epoch 1816
Loss = 2.1458e-08, PNorm = 109.5250, GNorm = 0.0000, lr_0 = 9.0999e-04
Validation auc = 0.649027
Epoch 1817
Validation auc = 0.649027
Epoch 1818
Validation auc = 0.649136
Epoch 1819
Validation auc = 0.649246
Epoch 1820
Loss = 2.1219e-07, PNorm = 109.5257, GNorm = 0.0000, lr_0 = 9.0978e-04
Loss = 5.9605e-08, PNorm = 109.5258, GNorm = 0.0000, lr_0 = 9.0976e-04
Validation auc = 0.649246
Epoch 1821
Validation auc = 0.649300
Epoch 1822
Validation auc = 0.649300
Epoch 1823
Validation auc = 0.649300
Epoch 1824
Validation auc = 0.649300
Epoch 1825
Loss = 2.2616e-05, PNorm = 109.5260, GNorm = 0.0023, lr_0 = 9.0955e-04
Validation auc = 0.649355
Epoch 1826
Validation auc = 0.649355
Epoch 1827
Validation auc = 0.649191
Epoch 1828
Validation auc = 0.649191
Epoch 1829
Validation auc = 0.649191
Epoch 1830
Loss = 3.3379e-08, PNorm = 109.5263, GNorm = 0.0000, lr_0 = 9.0931e-04
Validation auc = 0.649191
Epoch 1831
Validation auc = 0.649191
Epoch 1832
Validation auc = 0.649191
Epoch 1833
Validation auc = 0.649191
Epoch 1834
Loss = 2.2279e-06, PNorm = 109.5264, GNorm = 0.0001, lr_0 = 9.0910e-04
Loss = 5.9605e-08, PNorm = 109.5264, GNorm = 0.0000, lr_0 = 9.0909e-04
Validation auc = 0.649191
Epoch 1835
Validation auc = 0.649191
Epoch 1836
Validation auc = 0.649191
Epoch 1837
Validation auc = 0.649246
Epoch 1838
Validation auc = 0.649246
Epoch 1839
Loss = 7.2835e-07, PNorm = 109.5266, GNorm = 0.0001, lr_0 = 9.0886e-04
Loss = 0.0000e+00, PNorm = 109.5266, GNorm = 0.0000, lr_0 = 9.0884e-04
Validation auc = 0.649246
Epoch 1840
Validation auc = 0.649191
Epoch 1841
Validation auc = 0.649082
Epoch 1842
Validation auc = 0.649082
Epoch 1843
Validation auc = 0.649082
Epoch 1844
Loss = 2.6226e-08, PNorm = 109.5267, GNorm = 0.0000, lr_0 = 9.0863e-04
Validation auc = 0.649082
Epoch 1845
Validation auc = 0.649082
Epoch 1846
Validation auc = 0.649082
Epoch 1847
Validation auc = 0.649082
Epoch 1848
Validation auc = 0.649027
Epoch 1849
Loss = 2.8204e-06, PNorm = 109.5270, GNorm = 0.0002, lr_0 = 9.0839e-04
Validation auc = 0.649027
Epoch 1850
Validation auc = 0.649136
Epoch 1851
Validation auc = 0.649136
Epoch 1852
Validation auc = 0.649136
Epoch 1853
Loss = 1.7797e-06, PNorm = 109.5274, GNorm = 0.0002, lr_0 = 9.0818e-04
Loss = 0.0000e+00, PNorm = 109.5274, GNorm = 0.0000, lr_0 = 9.0817e-04
Validation auc = 0.649136
Epoch 1854
Validation auc = 0.649027
Epoch 1855
Validation auc = 0.649136
Epoch 1856
Validation auc = 0.649191
Epoch 1857
Validation auc = 0.649191
Epoch 1858
Loss = 1.1444e-07, PNorm = 109.5277, GNorm = 0.0000, lr_0 = 9.0794e-04
Validation auc = 0.649191
Epoch 1859
Validation auc = 0.649191
Epoch 1860
Validation auc = 0.649191
Epoch 1861
Validation auc = 0.649136
Epoch 1862
Validation auc = 0.649136
Epoch 1863
Loss = 3.3282e-06, PNorm = 109.5279, GNorm = 0.0002, lr_0 = 9.0772e-04
Validation auc = 0.649136
Epoch 1864
Validation auc = 0.649082
Epoch 1865
Validation auc = 0.649082
Epoch 1866
Validation auc = 0.649082
Epoch 1867
Loss = 2.2606e-04, PNorm = 109.5278, GNorm = 0.0000, lr_0 = 9.0751e-04
Loss = 0.0000e+00, PNorm = 109.5277, GNorm = 0.0000, lr_0 = 9.0749e-04
Validation auc = 0.649464
Epoch 1868
Validation auc = 0.649683
Epoch 1869
Validation auc = 0.650284
Epoch 1870
Validation auc = 0.650612
Epoch 1871
Validation auc = 0.650612
Epoch 1872
Loss = 1.8929e-06, PNorm = 109.5278, GNorm = 0.0003, lr_0 = 9.0727e-04
Loss = 9.4173e-06, PNorm = 109.5278, GNorm = 0.0005, lr_0 = 9.0725e-04
Validation auc = 0.650558
Epoch 1873
Validation auc = 0.650722
Epoch 1874
Validation auc = 0.650831
Epoch 1875
Validation auc = 0.650995
Epoch 1876
Validation auc = 0.650995
Epoch 1877
Loss = 1.1921e-08, PNorm = 109.5283, GNorm = 0.0000, lr_0 = 9.0704e-04
Validation auc = 0.650995
Epoch 1878
Validation auc = 0.650995
Epoch 1879
Validation auc = 0.650940
Epoch 1880
Validation auc = 0.650940
Epoch 1881
Validation auc = 0.650940
Epoch 1882
Loss = 3.3379e-08, PNorm = 109.5285, GNorm = 0.0000, lr_0 = 9.0680e-04
Validation auc = 0.650886
Epoch 1883
Validation auc = 0.650886
Epoch 1884
Validation auc = 0.650886
Epoch 1885
Validation auc = 0.650886
Epoch 1886
Loss = 4.1365e-07, PNorm = 109.5286, GNorm = 0.0000, lr_0 = 9.0659e-04
Loss = 3.9736e-08, PNorm = 109.5286, GNorm = 0.0000, lr_0 = 9.0657e-04
Validation auc = 0.650886
Epoch 1887
Validation auc = 0.650886
Epoch 1888
Validation auc = 0.650886
Epoch 1889
Validation auc = 0.650886
Epoch 1890
Validation auc = 0.650558
Epoch 1891
Loss = 4.4584e-07, PNorm = 109.5280, GNorm = 0.0000, lr_0 = 9.0635e-04
Validation auc = 0.644599
Epoch 1892
Validation auc = 0.652416
Epoch 1893
Validation auc = 0.644599
Epoch 1894
Validation auc = 0.659633
Epoch 1895
Validation auc = 0.658703
Epoch 1896
Loss = 3.8513e-05, PNorm = 109.7372, GNorm = 0.0016, lr_0 = 9.0612e-04
Validation auc = 0.665646
Epoch 1897
Validation auc = 0.653783
Epoch 1898
Validation auc = 0.638804
Epoch 1899
Validation auc = 0.633884
Epoch 1900
Loss = 1.2113e-01, PNorm = 110.4551, GNorm = 0.6638, lr_0 = 9.0592e-04
Loss = 5.7154e-02, PNorm = 110.5168, GNorm = 1.0987, lr_0 = 9.0590e-04
Validation auc = 0.660289
Epoch 1901
Validation auc = 0.667286
Epoch 1902
Validation auc = 0.674503
Epoch 1903
Validation auc = 0.689591
Epoch 1904
Validation auc = 0.692598
Epoch 1905
Loss = 2.9200e-02, PNorm = 111.2572, GNorm = 0.8982, lr_0 = 9.0567e-04
Loss = 1.8945e-02, PNorm = 111.3044, GNorm = 0.5797, lr_0 = 9.0566e-04
Validation auc = 0.703258
Epoch 1906
Validation auc = 0.708397
Epoch 1907
Validation auc = 0.709490
Epoch 1908
Validation auc = 0.693855
Epoch 1909
Validation auc = 0.699759
Epoch 1910
Loss = 2.9098e-03, PNorm = 111.7452, GNorm = 0.2254, lr_0 = 9.0545e-04
Validation auc = 0.708780
Epoch 1911
Validation auc = 0.702876
Epoch 1912
Validation auc = 0.699705
Epoch 1913
Validation auc = 0.673190
Epoch 1914
Validation auc = 0.676088
Epoch 1915
Loss = 2.8483e-03, PNorm = 112.2648, GNorm = 0.0587, lr_0 = 9.0521e-04
Validation auc = 0.670184
Epoch 1916
Validation auc = 0.671550
Epoch 1917
Validation auc = 0.689974
Epoch 1918
Validation auc = 0.699814
Epoch 1919
Loss = 4.0129e-02, PNorm = 112.7634, GNorm = 1.5212, lr_0 = 9.0500e-04
Loss = 5.2440e-01, PNorm = 112.7924, GNorm = 5.9558, lr_0 = 9.0498e-04
Validation auc = 0.700853
Epoch 1920
Validation auc = 0.698229
Epoch 1921
Validation auc = 0.695222
Epoch 1922
Validation auc = 0.675705
Epoch 1923
Validation auc = 0.708725
Epoch 1924
Loss = 1.3324e-01, PNorm = 113.2636, GNorm = 1.1752, lr_0 = 9.0476e-04
Validation auc = 0.722010
Epoch 1925
Validation auc = 0.709490
Epoch 1926
Validation auc = 0.688224
Epoch 1927
Validation auc = 0.677072
Epoch 1928
Validation auc = 0.676853
Epoch 1929
Loss = 2.6043e-02, PNorm = 114.0080, GNorm = 0.4200, lr_0 = 9.0454e-04
Validation auc = 0.680461
Epoch 1930
Validation auc = 0.679860
Epoch 1931
Validation auc = 0.696862
Epoch 1932
Validation auc = 0.674776
Epoch 1933
Loss = 3.0655e-03, PNorm = 114.5696, GNorm = 0.0275, lr_0 = 9.0431e-04
Validation auc = 0.667450
Epoch 1934
Validation auc = 0.683742
Epoch 1935
Validation auc = 0.695441
Epoch 1936
Validation auc = 0.684726
Epoch 1937
Validation auc = 0.684944
Epoch 1938
Loss = 5.6237e-02, PNorm = 115.0091, GNorm = 0.6819, lr_0 = 9.0409e-04
Loss = 9.8764e-03, PNorm = 115.0476, GNorm = 0.2607, lr_0 = 9.0407e-04
Validation auc = 0.688006
Epoch 1939
Validation auc = 0.678111
Epoch 1940
Validation auc = 0.671988
Epoch 1941
Validation auc = 0.669036
Epoch 1942
Validation auc = 0.669309
Epoch 1943
Loss = 4.5959e-02, PNorm = 115.4859, GNorm = 2.1352, lr_0 = 9.0386e-04
Validation auc = 0.681992
Epoch 1944
Validation auc = 0.670348
Epoch 1945
Validation auc = 0.654111
Epoch 1946
Validation auc = 0.645528
Epoch 1947
Validation auc = 0.638859
Epoch 1948
Loss = 8.1928e-03, PNorm = 115.7966, GNorm = 0.2752, lr_0 = 9.0362e-04
Validation auc = 0.645528
Epoch 1949
Validation auc = 0.661109
Epoch 1950
Validation auc = 0.674831
Epoch 1951
Validation auc = 0.682648
Epoch 1952
Loss = 6.2205e-03, PNorm = 115.9733, GNorm = 0.2558, lr_0 = 9.0341e-04
Loss = 8.0907e-02, PNorm = 115.9898, GNorm = 6.0634, lr_0 = 9.0340e-04
Validation auc = 0.689454
Epoch 1953
Validation auc = 0.691614
Epoch 1954
Validation auc = 0.691176
Epoch 1955
Validation auc = 0.696616
Epoch 1956
Validation auc = 0.699377
Epoch 1957
Loss = 1.6479e-02, PNorm = 116.1810, GNorm = 0.0645, lr_0 = 9.0317e-04
Loss = 5.3801e-01, PNorm = 116.1939, GNorm = 9.2902, lr_0 = 9.0316e-04
Validation auc = 0.700169
Epoch 1958
Validation auc = 0.684152
Epoch 1959
Validation auc = 0.696425
Epoch 1960
Validation auc = 0.696698
Epoch 1961
Validation auc = 0.689755
Epoch 1962
Loss = 2.4297e-02, PNorm = 116.5443, GNorm = 0.4991, lr_0 = 9.0295e-04
Validation auc = 0.690028
Epoch 1963
Validation auc = 0.700798
Epoch 1964
Validation auc = 0.707741
Epoch 1965
Validation auc = 0.704734
Epoch 1966
Loss = 3.1419e-02, PNorm = 116.8374, GNorm = 0.6306, lr_0 = 9.0273e-04
Validation auc = 0.697081
Epoch 1967
Validation auc = 0.692106
Epoch 1968
Validation auc = 0.681746
Epoch 1969
Validation auc = 0.680625
Epoch 1970
Validation auc = 0.679860
Epoch 1971
Loss = 1.4338e-03, PNorm = 117.0827, GNorm = 0.0660, lr_0 = 9.0250e-04
Loss = 1.8520e-03, PNorm = 117.0983, GNorm = 0.1145, lr_0 = 9.0249e-04
Validation auc = 0.673874
Epoch 1972
Validation auc = 0.638941
Epoch 1973
Validation auc = 0.616772
Epoch 1974
Validation auc = 0.607151
Epoch 1975
Validation auc = 0.599278
Epoch 1976
Loss = 7.8445e-03, PNorm = 117.2367, GNorm = 0.1484, lr_0 = 9.0228e-04
Validation auc = 0.583698
Epoch 1977
Validation auc = 0.573475
Epoch 1978
Validation auc = 0.681992
Epoch 1979
Validation auc = 0.689536
Epoch 1980
Validation auc = 0.700525
Epoch 1981
Loss = 1.5717e-01, PNorm = 117.7851, GNorm = 1.5229, lr_0 = 9.0204e-04
Validation auc = 0.704242
Epoch 1982
Validation auc = 0.692543
Epoch 1983
Validation auc = 0.676799
Epoch 1984
Validation auc = 0.661874
Epoch 1985
Loss = 1.2037e-02, PNorm = 118.5532, GNorm = 0.3317, lr_0 = 9.0183e-04
Loss = 1.1301e-03, PNorm = 118.5958, GNorm = 0.0340, lr_0 = 9.0181e-04
Validation auc = 0.652416
Epoch 1986
Validation auc = 0.652908
Epoch 1987
Validation auc = 0.655642
Epoch 1988
Validation auc = 0.654822
Epoch 1989
Validation auc = 0.656298
Epoch 1990
Loss = 5.8638e-02, PNorm = 118.9493, GNorm = 3.6767, lr_0 = 9.0159e-04
Loss = 6.3595e-04, PNorm = 118.9692, GNorm = 0.0396, lr_0 = 9.0157e-04
Validation auc = 0.657829
Epoch 1991
Validation auc = 0.659933
Epoch 1992
Validation auc = 0.662475
Epoch 1993
Validation auc = 0.665646
Epoch 1994
Validation auc = 0.667122
Epoch 1995
Loss = 1.2238e-02, PNorm = 119.1987, GNorm = 0.4356, lr_0 = 9.0137e-04
Validation auc = 0.675487
Epoch 1996
Validation auc = 0.684015
Epoch 1997
Validation auc = 0.689427
Epoch 1998
Validation auc = 0.692379
Epoch 1999
Loss = 4.9028e-03, PNorm = 119.3222, GNorm = 0.3965, lr_0 = 9.0114e-04
Validation auc = 0.693527
Model 0 best validation auc = 0.729609 on epoch 242
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.614835
Ensemble test auc = 0.614835
Fold 8
Splitting data with seed 8
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.394927
Epoch 1
Validation auc = 0.394325
Epoch 2
Validation auc = 0.453477
Epoch 3
Validation auc = 0.436639
Epoch 4
Loss = 6.8098e-01, PNorm = 71.6143, GNorm = 0.9876, lr_0 = 2.0385e-04
Loss = 7.4079e-01, PNorm = 71.6156, GNorm = 2.8233, lr_0 = 2.1077e-04
Validation auc = 0.560300
Epoch 5
Validation auc = 0.479663
Epoch 6
Validation auc = 0.551389
Epoch 7
Validation auc = 0.513011
Epoch 8
Validation auc = 0.492838
Epoch 9
Loss = 6.9712e-01, PNorm = 71.6395, GNorm = 1.7107, lr_0 = 3.0077e-04
Validation auc = 0.602340
Epoch 10
Validation auc = 0.652088
Epoch 11
Validation auc = 0.592117
Epoch 12
Validation auc = 0.695823
Epoch 13
Validation auc = 0.668270
Epoch 14
Loss = 6.7082e-01, PNorm = 71.6818, GNorm = 0.8672, lr_0 = 4.0462e-04
Validation auc = 0.630932
Epoch 15
Validation auc = 0.670457
Epoch 16
Validation auc = 0.618522
Epoch 17
Validation auc = 0.667122
Epoch 18
Loss = 6.7702e-01, PNorm = 71.7347, GNorm = 1.2320, lr_0 = 4.9462e-04
Loss = 6.3539e-01, PNorm = 71.7395, GNorm = 2.2516, lr_0 = 5.0154e-04
Validation auc = 0.632626
Epoch 19
Validation auc = 0.612946
Epoch 20
Validation auc = 0.640991
Epoch 21
Validation auc = 0.573584
Epoch 22
Validation auc = 0.636289
Epoch 23
Loss = 6.5566e-01, PNorm = 71.8288, GNorm = 2.2056, lr_0 = 5.9846e-04
Loss = 7.7179e-01, PNorm = 71.8345, GNorm = 2.3700, lr_0 = 6.0538e-04
Validation auc = 0.633720
Epoch 24
Validation auc = 0.661874
Epoch 25
Validation auc = 0.650831
Epoch 26
Validation auc = 0.650284
Epoch 27
Validation auc = 0.637601
Epoch 28
Loss = 6.9211e-01, PNorm = 71.9315, GNorm = 1.0773, lr_0 = 6.9538e-04
Validation auc = 0.577138
Epoch 29
Validation auc = 0.622130
Epoch 30
Validation auc = 0.613547
Epoch 31
Validation auc = 0.619342
Epoch 32
Validation auc = 0.639077
Epoch 33
Loss = 6.6454e-01, PNorm = 72.0502, GNorm = 1.3421, lr_0 = 7.9923e-04
Validation auc = 0.622458
Epoch 34
Validation auc = 0.610157
Epoch 35
Validation auc = 0.605401
Epoch 36
Validation auc = 0.602887
Epoch 37
Loss = 6.2685e-01, PNorm = 72.1667, GNorm = 0.3362, lr_0 = 8.8923e-04
Loss = 7.2171e-01, PNorm = 72.1773, GNorm = 0.8984, lr_0 = 8.9615e-04
Validation auc = 0.583971
Epoch 38
Validation auc = 0.575005
Epoch 39
Validation auc = 0.578340
Epoch 40
Validation auc = 0.577028
Epoch 41
Validation auc = 0.597420
Epoch 42
Loss = 6.9784e-01, PNorm = 72.3327, GNorm = 0.5144, lr_0 = 9.8615e-04
Validation auc = 0.587470
Epoch 43
Validation auc = 0.584682
Epoch 44
Validation auc = 0.581456
Epoch 45
Validation auc = 0.593483
Epoch 46
Validation auc = 0.597693
Epoch 47
Loss = 6.1188e-01, PNorm = 72.5459, GNorm = 0.4220, lr_0 = 9.9977e-04
Validation auc = 0.608681
Epoch 48
Validation auc = 0.607752
Epoch 49
Validation auc = 0.608353
Epoch 50
Validation auc = 0.641319
Epoch 51
Loss = 6.3832e-01, PNorm = 72.7652, GNorm = 0.6234, lr_0 = 9.9954e-04
Loss = 6.3228e-01, PNorm = 72.7810, GNorm = 1.2916, lr_0 = 9.9952e-04
Validation auc = 0.633064
Epoch 52
Validation auc = 0.648863
Epoch 53
Validation auc = 0.646621
Epoch 54
Validation auc = 0.640663
Epoch 55
Validation auc = 0.630986
Epoch 56
Loss = 5.6726e-01, PNorm = 73.0311, GNorm = 2.3960, lr_0 = 9.9927e-04
Loss = 4.1548e-01, PNorm = 73.0468, GNorm = 1.7604, lr_0 = 9.9926e-04
Validation auc = 0.623825
Epoch 57
Validation auc = 0.598950
Epoch 58
Validation auc = 0.585393
Epoch 59
Validation auc = 0.584627
Epoch 60
Validation auc = 0.572928
Epoch 61
Loss = 5.6111e-01, PNorm = 73.2698, GNorm = 0.3746, lr_0 = 9.9903e-04
Validation auc = 0.556910
Epoch 62
Validation auc = 0.565657
Epoch 63
Validation auc = 0.560518
Epoch 64
Validation auc = 0.581511
Epoch 65
Validation auc = 0.602613
Epoch 66
Loss = 4.5046e-01, PNorm = 73.5392, GNorm = 0.7007, lr_0 = 9.9876e-04
Validation auc = 0.586759
Epoch 67
Validation auc = 0.596764
Epoch 68
Validation auc = 0.608845
Epoch 69
Validation auc = 0.601902
Epoch 70
Loss = 4.5792e-01, PNorm = 73.8287, GNorm = 0.6407, lr_0 = 9.9853e-04
Loss = 2.7350e-01, PNorm = 73.8584, GNorm = 1.2152, lr_0 = 9.9851e-04
Validation auc = 0.605565
Epoch 71
Validation auc = 0.610103
Epoch 72
Validation auc = 0.612672
Epoch 73
Validation auc = 0.598841
Epoch 74
Validation auc = 0.641155
Epoch 75
Loss = 4.4508e-01, PNorm = 74.1908, GNorm = 0.6813, lr_0 = 9.9828e-04
Validation auc = 0.637000
Epoch 76
Validation auc = 0.627159
Epoch 77
Validation auc = 0.645637
Epoch 78
Validation auc = 0.656681
Epoch 79
Validation auc = 0.634922
Epoch 80
Loss = 6.3697e-01, PNorm = 74.6421, GNorm = 2.2300, lr_0 = 9.9802e-04
Validation auc = 0.640444
Epoch 81
Validation auc = 0.605675
Epoch 82
Validation auc = 0.605401
Epoch 83
Validation auc = 0.589657
Epoch 84
Loss = 4.2352e-01, PNorm = 75.0274, GNorm = 0.9240, lr_0 = 9.9779e-04
Loss = 3.2540e-01, PNorm = 75.0543, GNorm = 3.9360, lr_0 = 9.9777e-04
Validation auc = 0.627433
Epoch 85
Validation auc = 0.625301
Epoch 86
Validation auc = 0.643396
Epoch 87
Validation auc = 0.503772
Epoch 88
Validation auc = 0.472720
Epoch 89
Loss = 6.4632e-01, PNorm = 75.4396, GNorm = 0.4796, lr_0 = 9.9752e-04
Loss = 7.5363e-01, PNorm = 75.4692, GNorm = 1.5481, lr_0 = 9.9750e-04
Validation auc = 0.506506
Epoch 90
Validation auc = 0.556801
Epoch 91
Validation auc = 0.521485
Epoch 92
Validation auc = 0.552591
Epoch 93
Validation auc = 0.600918
Epoch 94
Loss = 5.5173e-01, PNorm = 75.8506, GNorm = 0.6144, lr_0 = 9.9727e-04
Validation auc = 0.635906
Epoch 95
Validation auc = 0.633228
Epoch 96
Validation auc = 0.633118
Epoch 97
Validation auc = 0.642685
Epoch 98
Validation auc = 0.648371
Epoch 99
Loss = 4.5426e-01, PNorm = 76.3061, GNorm = 2.3767, lr_0 = 9.9701e-04
Validation auc = 0.660070
Epoch 100
Validation auc = 0.686420
Epoch 101
Validation auc = 0.679696
Epoch 102
Validation auc = 0.663623
Epoch 103
Loss = 3.8388e-01, PNorm = 76.7101, GNorm = 4.4019, lr_0 = 9.9678e-04
Loss = 4.5280e-01, PNorm = 76.7397, GNorm = 1.9491, lr_0 = 9.9676e-04
Validation auc = 0.662749
Epoch 104
Validation auc = 0.680516
Epoch 105
Validation auc = 0.676033
Epoch 106
Validation auc = 0.674339
Epoch 107
Validation auc = 0.667450
Epoch 108
Loss = 4.0290e-01, PNorm = 77.0999, GNorm = 4.4999, lr_0 = 9.9651e-04
Validation auc = 0.658266
Epoch 109
Validation auc = 0.668434
Epoch 110
Validation auc = 0.667341
Epoch 111
Validation auc = 0.650667
Epoch 112
Validation auc = 0.658594
Epoch 113
Loss = 4.6163e-01, PNorm = 77.4103, GNorm = 4.7800, lr_0 = 9.9627e-04
Validation auc = 0.644107
Epoch 114
Validation auc = 0.620982
Epoch 115
Validation auc = 0.620326
Epoch 116
Validation auc = 0.641756
Epoch 117
Loss = 3.5678e-01, PNorm = 77.6890, GNorm = 1.6526, lr_0 = 9.9604e-04
Loss = 1.3133e-01, PNorm = 77.7153, GNorm = 0.9655, lr_0 = 9.9602e-04
Validation auc = 0.665920
Epoch 118
Validation auc = 0.670512
Epoch 119
Validation auc = 0.673245
Epoch 120
Validation auc = 0.681172
Epoch 121
Validation auc = 0.680188
Epoch 122
Loss = 1.8751e-01, PNorm = 78.0314, GNorm = 1.6969, lr_0 = 9.9577e-04
Loss = 1.2253e-01, PNorm = 78.0598, GNorm = 2.9456, lr_0 = 9.9575e-04
Validation auc = 0.683359
Epoch 123
Validation auc = 0.686038
Epoch 124
Validation auc = 0.654166
Epoch 125
Validation auc = 0.649683
Epoch 126
Validation auc = 0.676252
Epoch 127
Loss = 7.1272e-01, PNorm = 78.3974, GNorm = 6.0236, lr_0 = 9.9552e-04
Validation auc = 0.684452
Epoch 128
Validation auc = 0.686912
Epoch 129
Validation auc = 0.683632
Epoch 130
Validation auc = 0.674010
Epoch 131
Validation auc = 0.654658
Epoch 132
Loss = 2.1926e-01, PNorm = 78.7813, GNorm = 1.5878, lr_0 = 9.9526e-04
Validation auc = 0.636945
Epoch 133
Validation auc = 0.626339
Epoch 134
Validation auc = 0.600809
Epoch 135
Validation auc = 0.594194
Epoch 136
Loss = 2.1277e-01, PNorm = 79.0841, GNorm = 1.2065, lr_0 = 9.9503e-04
Loss = 9.3351e-01, PNorm = 79.1025, GNorm = 5.6283, lr_0 = 9.9501e-04
Validation auc = 0.629565
Epoch 137
Validation auc = 0.649574
Epoch 138
Validation auc = 0.646567
Epoch 139
Validation auc = 0.674557
Epoch 140
Validation auc = 0.693965
Epoch 141
Loss = 2.9483e-01, PNorm = 79.4538, GNorm = 1.1831, lr_0 = 9.9477e-04
Validation auc = 0.685710
Epoch 142
Validation auc = 0.602887
Epoch 143
Validation auc = 0.625683
Epoch 144
Validation auc = 0.651651
Epoch 145
Validation auc = 0.650995
Epoch 146
Loss = 2.6763e-01, PNorm = 79.8571, GNorm = 0.9463, lr_0 = 9.9452e-04
Validation auc = 0.644107
Epoch 147
Validation auc = 0.640335
Epoch 148
Validation auc = 0.651378
Epoch 149
Validation auc = 0.645747
Epoch 150
Loss = 1.8257e-01, PNorm = 80.2215, GNorm = 1.5853, lr_0 = 9.9429e-04
Loss = 5.1891e-02, PNorm = 80.2422, GNorm = 1.2492, lr_0 = 9.9427e-04
Validation auc = 0.639569
Epoch 151
Validation auc = 0.651651
Epoch 152
Validation auc = 0.649464
Epoch 153
Validation auc = 0.641701
Epoch 154
Validation auc = 0.643177
Epoch 155
Loss = 1.5836e-01, PNorm = 80.4925, GNorm = 2.0228, lr_0 = 9.9403e-04
Loss = 7.5763e-03, PNorm = 80.5065, GNorm = 0.1484, lr_0 = 9.9401e-04
Validation auc = 0.648371
Epoch 156
Validation auc = 0.645637
Epoch 157
Validation auc = 0.646239
Epoch 158
Validation auc = 0.643888
Epoch 159
Validation auc = 0.651924
Epoch 160
Loss = 3.8875e-01, PNorm = 80.7454, GNorm = 2.4567, lr_0 = 9.9378e-04
Validation auc = 0.653346
Epoch 161
Validation auc = 0.653947
Epoch 162
Validation auc = 0.655095
Epoch 163
Validation auc = 0.662967
Epoch 164
Validation auc = 0.681609
Epoch 165
Loss = 2.6652e-01, PNorm = 81.0745, GNorm = 1.6708, lr_0 = 9.9351e-04
Validation auc = 0.683796
Epoch 166
Validation auc = 0.681117
Epoch 167
Validation auc = 0.678712
Epoch 168
Validation auc = 0.680625
Epoch 169
Loss = 1.5087e-01, PNorm = 81.3411, GNorm = 3.8843, lr_0 = 9.9329e-04
Loss = 1.6815e-01, PNorm = 81.3602, GNorm = 7.2334, lr_0 = 9.9327e-04
Validation auc = 0.684780
Epoch 170
Validation auc = 0.684179
Epoch 171
Validation auc = 0.677892
Epoch 172
Validation auc = 0.690684
Epoch 173
Validation auc = 0.704953
Epoch 174
Loss = 1.8018e-01, PNorm = 81.6328, GNorm = 1.4563, lr_0 = 9.9302e-04
Validation auc = 0.708178
Epoch 175
Validation auc = 0.704024
Epoch 176
Validation auc = 0.692161
Epoch 177
Validation auc = 0.679641
Epoch 178
Validation auc = 0.670840
Epoch 179
Loss = 1.2863e-01, PNorm = 81.8291, GNorm = 0.6348, lr_0 = 9.9277e-04
Validation auc = 0.670129
Epoch 180
Validation auc = 0.668872
Epoch 181
Validation auc = 0.668216
Epoch 182
Validation auc = 0.659797
Epoch 183
Loss = 1.7505e-01, PNorm = 82.0078, GNorm = 4.8928, lr_0 = 9.9253e-04
Validation auc = 0.658977
Epoch 184
Validation auc = 0.671113
Epoch 185
Validation auc = 0.676635
Epoch 186
Validation auc = 0.676744
Epoch 187
Validation auc = 0.672316
Epoch 188
Loss = 8.1024e-02, PNorm = 82.2029, GNorm = 1.2155, lr_0 = 9.9228e-04
Loss = 1.1426e-02, PNorm = 82.2141, GNorm = 0.2351, lr_0 = 9.9226e-04
Validation auc = 0.685054
Epoch 189
Validation auc = 0.682211
Epoch 190
Validation auc = 0.662694
Epoch 191
Validation auc = 0.669637
Epoch 192
Validation auc = 0.670676
Epoch 193
Loss = 1.1981e-02, PNorm = 82.3543, GNorm = 0.1622, lr_0 = 9.9204e-04
Validation auc = 0.670676
Epoch 194
Validation auc = 0.667013
Epoch 195
Validation auc = 0.668434
Epoch 196
Validation auc = 0.667833
Epoch 197
Validation auc = 0.669528
Epoch 198
Loss = 1.8003e-01, PNorm = 82.5361, GNorm = 1.3413, lr_0 = 9.9177e-04
Validation auc = 0.670785
Epoch 199
Validation auc = 0.667068
Epoch 200
Validation auc = 0.668216
Epoch 201
Validation auc = 0.669856
Epoch 202
Loss = 8.2764e-02, PNorm = 82.6593, GNorm = 0.4809, lr_0 = 9.9154e-04
Loss = 8.6739e-03, PNorm = 82.6673, GNorm = 0.1520, lr_0 = 9.9153e-04
Validation auc = 0.668872
Epoch 203
Validation auc = 0.668653
Epoch 204
Validation auc = 0.668926
Epoch 205
Validation auc = 0.669528
Epoch 206
Validation auc = 0.667888
Epoch 207
Loss = 7.8599e-02, PNorm = 82.7672, GNorm = 0.1334, lr_0 = 9.9128e-04
Loss = 2.5696e-03, PNorm = 82.7731, GNorm = 0.0530, lr_0 = 9.9126e-04
Validation auc = 0.664006
Epoch 208
Validation auc = 0.661710
Epoch 209
Validation auc = 0.658211
Epoch 210
Validation auc = 0.655532
Epoch 211
Validation auc = 0.648480
Epoch 212
Loss = 1.0237e-01, PNorm = 82.8345, GNorm = 0.6489, lr_0 = 9.9103e-04
Validation auc = 0.644763
Epoch 213
Validation auc = 0.641045
Epoch 214
Validation auc = 0.640499
Epoch 215
Validation auc = 0.638749
Epoch 216
Loss = 4.3202e-02, PNorm = 82.8872, GNorm = 0.1102, lr_0 = 9.9079e-04
Validation auc = 0.638202
Epoch 217
Validation auc = 0.638476
Epoch 218
Validation auc = 0.643013
Epoch 219
Validation auc = 0.649136
Epoch 220
Validation auc = 0.660453
Epoch 221
Loss = 3.1073e-01, PNorm = 82.9297, GNorm = 9.7123, lr_0 = 9.9054e-04
Loss = 1.6075e+00, PNorm = 82.9312, GNorm = 15.0398, lr_0 = 9.9052e-04
Validation auc = 0.668708
Epoch 222
Validation auc = 0.631287
Epoch 223
Validation auc = 0.617483
Epoch 224
Validation auc = 0.628307
Epoch 225
Validation auc = 0.653127
Epoch 226
Loss = 1.8012e-01, PNorm = 83.2233, GNorm = 1.1208, lr_0 = 9.9030e-04
Validation auc = 0.671222
Epoch 227
Validation auc = 0.685272
Epoch 228
Validation auc = 0.689318
Epoch 229
Validation auc = 0.679532
Epoch 230
Validation auc = 0.664717
Epoch 231
Loss = 1.7054e-01, PNorm = 83.6459, GNorm = 0.8264, lr_0 = 9.9003e-04
Validation auc = 0.642412
Epoch 232
Validation auc = 0.621310
Epoch 233
Validation auc = 0.620545
Epoch 234
Validation auc = 0.629620
Epoch 235
Loss = 9.6270e-02, PNorm = 83.9490, GNorm = 1.4284, lr_0 = 9.8980e-04
Loss = 1.7519e-01, PNorm = 83.9789, GNorm = 12.0930, lr_0 = 9.8979e-04
Validation auc = 0.651979
Epoch 236
Validation auc = 0.677017
Epoch 237
Validation auc = 0.687022
Epoch 238
Validation auc = 0.681883
Epoch 239
Validation auc = 0.684507
Epoch 240
Loss = 7.8749e-02, PNorm = 84.3946, GNorm = 0.5781, lr_0 = 9.8954e-04
Loss = 4.2953e-01, PNorm = 84.4202, GNorm = 3.3178, lr_0 = 9.8952e-04
Validation auc = 0.698010
Epoch 241
Validation auc = 0.705226
Epoch 242
Validation auc = 0.705281
Epoch 243
Validation auc = 0.709326
Epoch 244
Validation auc = 0.715121
Epoch 245
Loss = 5.3060e-02, PNorm = 84.6888, GNorm = 0.4308, lr_0 = 9.8930e-04
Validation auc = 0.718019
Epoch 246
Validation auc = 0.715067
Epoch 247
Validation auc = 0.709326
Epoch 248
Validation auc = 0.706484
Epoch 249
Loss = 2.6828e-01, PNorm = 84.8953, GNorm = 5.1318, lr_0 = 9.8905e-04
Validation auc = 0.702657
Epoch 250
Validation auc = 0.690739
Epoch 251
Validation auc = 0.689864
Epoch 252
Validation auc = 0.688880
Epoch 253
Validation auc = 0.684343
Epoch 254
Loss = 2.5900e-02, PNorm = 85.0128, GNorm = 1.0396, lr_0 = 9.8880e-04
Loss = 1.0200e-02, PNorm = 85.0205, GNorm = 0.2916, lr_0 = 9.8879e-04
Validation auc = 0.682648
Epoch 255
Validation auc = 0.679805
Epoch 256
Validation auc = 0.674229
Epoch 257
Validation auc = 0.674995
Epoch 258
Validation auc = 0.679696
Epoch 259
Loss = 1.0605e-01, PNorm = 85.1088, GNorm = 0.5651, lr_0 = 9.8856e-04
Validation auc = 0.688224
Epoch 260
Validation auc = 0.691942
Epoch 261
Validation auc = 0.688115
Epoch 262
Validation auc = 0.679641
Epoch 263
Validation auc = 0.670676
Epoch 264
Loss = 2.1795e-02, PNorm = 85.2465, GNorm = 0.6622, lr_0 = 9.8830e-04
Validation auc = 0.669473
Epoch 265
Validation auc = 0.673190
Epoch 266
Validation auc = 0.679095
Epoch 267
Validation auc = 0.685108
Epoch 268
Loss = 4.4110e-02, PNorm = 85.3537, GNorm = 0.0802, lr_0 = 9.8807e-04
Loss = 5.4214e-03, PNorm = 85.3608, GNorm = 0.0938, lr_0 = 9.8805e-04
Validation auc = 0.689646
Epoch 269
Validation auc = 0.694894
Epoch 270
Validation auc = 0.699759
Epoch 271
Validation auc = 0.704406
Epoch 272
Validation auc = 0.707850
Epoch 273
Loss = 9.9820e-02, PNorm = 85.4526, GNorm = 2.1120, lr_0 = 9.8781e-04
Loss = 5.5024e-01, PNorm = 85.4566, GNorm = 4.4004, lr_0 = 9.8779e-04
Validation auc = 0.703094
Epoch 274
Validation auc = 0.696971
Epoch 275
Validation auc = 0.694621
Epoch 276
Validation auc = 0.699213
Epoch 277
Validation auc = 0.703696
Epoch 278
Loss = 8.1949e-02, PNorm = 85.5930, GNorm = 1.1954, lr_0 = 9.8756e-04
Validation auc = 0.706046
Epoch 279
Validation auc = 0.699213
Epoch 280
Validation auc = 0.694293
Epoch 281
Validation auc = 0.689974
Epoch 282
Validation auc = 0.699814
Epoch 283
Loss = 6.2157e-02, PNorm = 85.7479, GNorm = 0.9513, lr_0 = 9.8730e-04
Validation auc = 0.708616
Epoch 284
Validation auc = 0.714629
Epoch 285
Validation auc = 0.706429
Epoch 286
Validation auc = 0.702985
Epoch 287
Loss = 1.0341e-01, PNorm = 85.9555, GNorm = 0.7337, lr_0 = 9.8707e-04
Loss = 3.6397e-02, PNorm = 85.9791, GNorm = 0.5928, lr_0 = 9.8705e-04
Validation auc = 0.707632
Epoch 288
Validation auc = 0.705828
Epoch 289
Validation auc = 0.701892
Epoch 290
Validation auc = 0.699486
Epoch 291
Validation auc = 0.690848
Epoch 292
Loss = 3.4043e-02, PNorm = 86.2770, GNorm = 0.8578, lr_0 = 9.8683e-04
Validation auc = 0.688006
Epoch 293
Validation auc = 0.685600
Epoch 294
Validation auc = 0.678712
Epoch 295
Validation auc = 0.710037
Epoch 296
Validation auc = 0.732943
Epoch 297
Loss = 8.9506e-02, PNorm = 86.5342, GNorm = 0.8600, lr_0 = 9.8656e-04
Validation auc = 0.739285
Epoch 298
Validation auc = 0.736716
Epoch 299
Validation auc = 0.725727
Epoch 300
Validation auc = 0.717253
Epoch 301
Loss = 8.9312e-02, PNorm = 86.7053, GNorm = 0.5128, lr_0 = 9.8634e-04
Loss = 5.1921e-02, PNorm = 86.7156, GNorm = 1.7964, lr_0 = 9.8632e-04
Validation auc = 0.711732
Epoch 302
Validation auc = 0.706101
Epoch 303
Validation auc = 0.699650
Epoch 304
Validation auc = 0.697846
Epoch 305
Validation auc = 0.700033
Epoch 306
Loss = 4.2432e-02, PNorm = 86.8346, GNorm = 1.0225, lr_0 = 9.8607e-04
Loss = 5.9955e-03, PNorm = 86.8440, GNorm = 0.1740, lr_0 = 9.8606e-04
Validation auc = 0.700908
Epoch 307
Validation auc = 0.700470
Epoch 308
Validation auc = 0.701509
Epoch 309
Validation auc = 0.701454
Epoch 310
Validation auc = 0.705773
Epoch 311
Loss = 1.7819e-01, PNorm = 86.9446, GNorm = 2.3257, lr_0 = 9.8583e-04
Validation auc = 0.713427
Epoch 312
Validation auc = 0.723267
Epoch 313
Validation auc = 0.716105
Epoch 314
Validation auc = 0.700087
Epoch 315
Validation auc = 0.686038
Epoch 316
Loss = 7.1479e-02, PNorm = 87.0758, GNorm = 0.6658, lr_0 = 9.8557e-04
Validation auc = 0.682047
Epoch 317
Validation auc = 0.687350
Epoch 318
Validation auc = 0.688662
Epoch 319
Validation auc = 0.695987
Epoch 320
Loss = 7.1505e-02, PNorm = 87.2471, GNorm = 0.5620, lr_0 = 9.8534e-04
Loss = 1.0218e-01, PNorm = 87.2625, GNorm = 1.5058, lr_0 = 9.8532e-04
Validation auc = 0.698939
Epoch 321
Validation auc = 0.695386
Epoch 322
Validation auc = 0.691504
Epoch 323
Validation auc = 0.685546
Epoch 324
Validation auc = 0.684835
Epoch 325
Loss = 3.7942e-02, PNorm = 87.4213, GNorm = 0.9012, lr_0 = 9.8509e-04
Validation auc = 0.685764
Epoch 326
Validation auc = 0.682921
Epoch 327
Validation auc = 0.679969
Epoch 328
Validation auc = 0.678493
Epoch 329
Validation auc = 0.677400
Epoch 330
Loss = 4.1201e-02, PNorm = 87.5649, GNorm = 0.9819, lr_0 = 9.8483e-04
Validation auc = 0.680024
Epoch 331
Validation auc = 0.683632
Epoch 332
Validation auc = 0.688826
Epoch 333
Validation auc = 0.691778
Epoch 334
Loss = 8.4434e-03, PNorm = 87.6656, GNorm = 0.1247, lr_0 = 9.8461e-04
Loss = 2.4157e-03, PNorm = 87.6735, GNorm = 0.0478, lr_0 = 9.8459e-04
Validation auc = 0.694949
Epoch 335
Validation auc = 0.696753
Epoch 336
Validation auc = 0.699869
Epoch 337
Validation auc = 0.700470
Epoch 338
Validation auc = 0.701618
Epoch 339
Loss = 3.9757e-03, PNorm = 87.7552, GNorm = 0.1708, lr_0 = 9.8434e-04
Loss = 1.2836e-03, PNorm = 87.7593, GNorm = 0.0516, lr_0 = 9.8433e-04
Validation auc = 0.701345
Epoch 340
Validation auc = 0.701290
Epoch 341
Validation auc = 0.697354
Epoch 342
Validation auc = 0.695714
Epoch 343
Validation auc = 0.692871
Epoch 344
Loss = 5.2951e-02, PNorm = 87.8177, GNorm = 3.2281, lr_0 = 9.8410e-04
Validation auc = 0.686912
Epoch 345
Validation auc = 0.680735
Epoch 346
Validation auc = 0.682375
Epoch 347
Validation auc = 0.681172
Epoch 348
Validation auc = 0.675979
Epoch 349
Loss = 2.3886e-01, PNorm = 87.9102, GNorm = 1.8375, lr_0 = 9.8384e-04
Validation auc = 0.668872
Epoch 350
Validation auc = 0.668872
Epoch 351
Validation auc = 0.676416
Epoch 352
Validation auc = 0.681500
Epoch 353
Loss = 4.7393e-02, PNorm = 87.9662, GNorm = 0.0630, lr_0 = 9.8361e-04
Loss = 3.0642e-03, PNorm = 87.9714, GNorm = 0.0450, lr_0 = 9.8359e-04
Validation auc = 0.686584
Epoch 354
Validation auc = 0.688334
Epoch 355
Validation auc = 0.684780
Epoch 356
Validation auc = 0.683086
Epoch 357
Validation auc = 0.681172
Epoch 358
Loss = 7.7098e-03, PNorm = 88.0566, GNorm = 0.1243, lr_0 = 9.8335e-04
Validation auc = 0.679696
Epoch 359
Validation auc = 0.677509
Epoch 360
Validation auc = 0.676635
Epoch 361
Validation auc = 0.676471
Epoch 362
Validation auc = 0.675760
Epoch 363
Loss = 6.6922e-03, PNorm = 88.1174, GNorm = 0.1511, lr_0 = 9.8311e-04
Validation auc = 0.674776
Epoch 364
Validation auc = 0.674612
Epoch 365
Validation auc = 0.673682
Epoch 366
Validation auc = 0.673081
Epoch 367
Loss = 1.0202e-01, PNorm = 88.1697, GNorm = 1.6812, lr_0 = 9.8288e-04
Loss = 1.6944e-04, PNorm = 88.1717, GNorm = 0.0050, lr_0 = 9.8286e-04
Validation auc = 0.671878
Epoch 368
Validation auc = 0.671441
Epoch 369
Validation auc = 0.670730
Epoch 370
Validation auc = 0.675760
Epoch 371
Validation auc = 0.683851
Epoch 372
Loss = 1.6126e-02, PNorm = 88.2344, GNorm = 0.8408, lr_0 = 9.8262e-04
Loss = 2.9202e-03, PNorm = 88.2415, GNorm = 0.2411, lr_0 = 9.8260e-04
Validation auc = 0.687568
Epoch 373
Validation auc = 0.680352
Epoch 374
Validation auc = 0.672042
Epoch 375
Validation auc = 0.667724
Epoch 376
Validation auc = 0.669145
Epoch 377
Loss = 3.5348e-02, PNorm = 88.3261, GNorm = 1.4569, lr_0 = 9.8237e-04
Validation auc = 0.671878
Epoch 378
Validation auc = 0.676033
Epoch 379
Validation auc = 0.674612
Epoch 380
Validation auc = 0.677127
Epoch 381
Validation auc = 0.675377
Epoch 382
Loss = 4.7433e-03, PNorm = 88.3904, GNorm = 0.0718, lr_0 = 9.8211e-04
Validation auc = 0.667068
Epoch 383
Validation auc = 0.659633
Epoch 384
Validation auc = 0.655259
Epoch 385
Validation auc = 0.664006
Epoch 386
Loss = 9.8739e-03, PNorm = 88.4621, GNorm = 0.3925, lr_0 = 9.8189e-04
Loss = 4.2546e-03, PNorm = 88.4700, GNorm = 0.0880, lr_0 = 9.8187e-04
Validation auc = 0.671714
Epoch 387
Validation auc = 0.675815
Epoch 388
Validation auc = 0.676908
Epoch 389
Validation auc = 0.680133
Epoch 390
Validation auc = 0.681937
Epoch 391
Loss = 8.6137e-02, PNorm = 88.5440, GNorm = 0.9919, lr_0 = 9.8163e-04
Validation auc = 0.683906
Epoch 392
Validation auc = 0.685928
Epoch 393
Validation auc = 0.688552
Epoch 394
Validation auc = 0.686420
Epoch 395
Validation auc = 0.684726
Epoch 396
Loss = 3.8020e-03, PNorm = 88.6066, GNorm = 0.0504, lr_0 = 9.8138e-04
Validation auc = 0.681992
Epoch 397
Validation auc = 0.680844
Epoch 398
Validation auc = 0.680243
Epoch 399
Validation auc = 0.680516
Epoch 400
Loss = 1.3865e-03, PNorm = 88.6505, GNorm = 0.0266, lr_0 = 9.8116e-04
Loss = 1.6349e-02, PNorm = 88.6535, GNorm = 1.0799, lr_0 = 9.8114e-04
Validation auc = 0.681883
Epoch 401
Validation auc = 0.684616
Epoch 402
Validation auc = 0.686311
Epoch 403
Validation auc = 0.687240
Epoch 404
Validation auc = 0.690083
Epoch 405
Loss = 6.4097e-03, PNorm = 88.6726, GNorm = 0.0465, lr_0 = 9.8089e-04
Loss = 6.0595e-04, PNorm = 88.6738, GNorm = 0.0158, lr_0 = 9.8088e-04
Validation auc = 0.691231
Epoch 406
Validation auc = 0.691778
Epoch 407
Validation auc = 0.693801
Epoch 408
Validation auc = 0.693418
Epoch 409
Validation auc = 0.693145
Epoch 410
Loss = 4.7408e-03, PNorm = 88.6964, GNorm = 0.0579, lr_0 = 9.8065e-04
Validation auc = 0.693309
Epoch 411
Validation auc = 0.693363
Epoch 412
Validation auc = 0.692981
Epoch 413
Validation auc = 0.693254
Epoch 414
Validation auc = 0.694894
Epoch 415
Loss = 6.3625e-02, PNorm = 88.7261, GNorm = 1.4789, lr_0 = 9.8039e-04
Validation auc = 0.694675
Epoch 416
Validation auc = 0.693691
Epoch 417
Validation auc = 0.693855
Epoch 418
Validation auc = 0.695714
Epoch 419
Loss = 1.2743e-03, PNorm = 88.7875, GNorm = 0.0119, lr_0 = 9.8016e-04
Loss = 9.9019e-05, PNorm = 88.7915, GNorm = 0.0036, lr_0 = 9.8015e-04
Validation auc = 0.696753
Epoch 420
Validation auc = 0.699431
Epoch 421
Validation auc = 0.701946
Epoch 422
Validation auc = 0.704297
Epoch 423
Validation auc = 0.704133
Epoch 424
Loss = 1.0551e-03, PNorm = 88.8157, GNorm = 0.0203, lr_0 = 9.7990e-04
Validation auc = 0.702930
Epoch 425
Validation auc = 0.702548
Epoch 426
Validation auc = 0.702110
Epoch 427
Validation auc = 0.701728
Epoch 428
Validation auc = 0.701892
Epoch 429
Loss = 6.2589e-04, PNorm = 88.8357, GNorm = 0.0143, lr_0 = 9.7966e-04
Validation auc = 0.701837
Epoch 430
Validation auc = 0.701236
Epoch 431
Validation auc = 0.701126
Epoch 432
Validation auc = 0.701017
Epoch 433
Loss = 6.2890e-04, PNorm = 88.8522, GNorm = 0.0303, lr_0 = 9.7942e-04
Validation auc = 0.700470
Epoch 434
Validation auc = 0.700306
Epoch 435
Validation auc = 0.700251
Epoch 436
Validation auc = 0.700579
Epoch 437
Validation auc = 0.698447
Epoch 438
Loss = 5.2228e-04, PNorm = 88.8541, GNorm = 0.0066, lr_0 = 9.7917e-04
Loss = 2.6338e-04, PNorm = 88.8540, GNorm = 0.0429, lr_0 = 9.7916e-04
Validation auc = 0.696753
Epoch 439
Validation auc = 0.695386
Epoch 440
Validation auc = 0.694347
Epoch 441
Validation auc = 0.692161
Epoch 442
Validation auc = 0.691176
Epoch 443
Loss = 5.4123e-02, PNorm = 88.8623, GNorm = 0.8423, lr_0 = 9.7893e-04
Validation auc = 0.687787
Epoch 444
Validation auc = 0.686803
Epoch 445
Validation auc = 0.689482
Epoch 446
Validation auc = 0.690684
Epoch 447
Validation auc = 0.696425
Epoch 448
Loss = 5.1318e-04, PNorm = 88.9299, GNorm = 0.0092, lr_0 = 9.7867e-04
Validation auc = 0.700525
Epoch 449
Validation auc = 0.698885
Epoch 450
Validation auc = 0.697299
Epoch 451
Validation auc = 0.702438
Epoch 452
Loss = 4.0085e-04, PNorm = 88.9816, GNorm = 0.0143, lr_0 = 9.7845e-04
Loss = 4.2908e-01, PNorm = 88.9918, GNorm = 32.2307, lr_0 = 9.7843e-04
Validation auc = 0.711951
Epoch 453
Validation auc = 0.697955
Epoch 454
Validation auc = 0.685655
Epoch 455
Validation auc = 0.662421
Epoch 456
Validation auc = 0.646949
Epoch 457
Loss = 2.0634e-01, PNorm = 89.5564, GNorm = 1.5924, lr_0 = 9.7819e-04
Loss = 1.0342e-01, PNorm = 89.5998, GNorm = 3.6086, lr_0 = 9.7817e-04
Validation auc = 0.654002
Epoch 458
Validation auc = 0.643669
Epoch 459
Validation auc = 0.673737
Epoch 460
Validation auc = 0.677619
Epoch 461
Validation auc = 0.681227
Epoch 462
Loss = 1.4463e-01, PNorm = 90.0345, GNorm = 2.8510, lr_0 = 9.7794e-04
Validation auc = 0.678493
Epoch 463
Validation auc = 0.702220
Epoch 464
Validation auc = 0.708889
Epoch 465
Validation auc = 0.707796
Epoch 466
Loss = 1.7688e-02, PNorm = 90.3296, GNorm = 0.0460, lr_0 = 9.7770e-04
Validation auc = 0.707413
Epoch 467
Validation auc = 0.697627
Epoch 468
Validation auc = 0.692161
Epoch 469
Validation auc = 0.686858
Epoch 470
Validation auc = 0.680680
Epoch 471
Loss = 1.0817e-02, PNorm = 90.5782, GNorm = 0.1983, lr_0 = 9.7746e-04
Loss = 1.1973e-02, PNorm = 90.5913, GNorm = 0.2413, lr_0 = 9.7744e-04
Validation auc = 0.676963
Epoch 472
Validation auc = 0.672206
Epoch 473
Validation auc = 0.662749
Epoch 474
Validation auc = 0.652198
Epoch 475
Validation auc = 0.646457
Epoch 476
Loss = 6.4716e-03, PNorm = 90.7364, GNorm = 0.1665, lr_0 = 9.7721e-04
Validation auc = 0.643943
Epoch 477
Validation auc = 0.636344
Epoch 478
Validation auc = 0.635688
Epoch 479
Validation auc = 0.637546
Epoch 480
Validation auc = 0.638531
Epoch 481
Loss = 6.6181e-03, PNorm = 90.8519, GNorm = 0.1846, lr_0 = 9.7695e-04
Validation auc = 0.630166
Epoch 482
Validation auc = 0.629620
Epoch 483
Validation auc = 0.649082
Epoch 484
Validation auc = 0.674175
Epoch 485
Loss = 1.8841e-01, PNorm = 91.0258, GNorm = 1.2254, lr_0 = 9.7673e-04
Loss = 1.4728e-02, PNorm = 91.0351, GNorm = 0.4049, lr_0 = 9.7671e-04
Validation auc = 0.674065
Epoch 486
Validation auc = 0.676197
Epoch 487
Validation auc = 0.676416
Epoch 488
Validation auc = 0.672589
Epoch 489
Validation auc = 0.674721
Epoch 490
Loss = 3.7277e-02, PNorm = 91.1713, GNorm = 0.3439, lr_0 = 9.7647e-04
Loss = 2.2837e-03, PNorm = 91.1810, GNorm = 0.0488, lr_0 = 9.7645e-04
Validation auc = 0.668216
Epoch 491
Validation auc = 0.662803
Epoch 492
Validation auc = 0.657391
Epoch 493
Validation auc = 0.653346
Epoch 494
Validation auc = 0.652143
Epoch 495
Loss = 1.2286e-02, PNorm = 91.2613, GNorm = 0.1923, lr_0 = 9.7623e-04
Validation auc = 0.656899
Epoch 496
Validation auc = 0.666630
Epoch 497
Validation auc = 0.676853
Epoch 498
Validation auc = 0.681117
Epoch 499
Loss = 2.5939e-02, PNorm = 91.3317, GNorm = 0.2111, lr_0 = 9.7599e-04
Validation auc = 0.676908
Epoch 500
Validation auc = 0.673136
Epoch 501
Validation auc = 0.673300
Epoch 502
Validation auc = 0.671824
Epoch 503
Validation auc = 0.670621
Epoch 504
Loss = 8.7941e-03, PNorm = 91.4218, GNorm = 0.1743, lr_0 = 9.7574e-04
Loss = 3.1002e-03, PNorm = 91.4289, GNorm = 0.0589, lr_0 = 9.7573e-04
Validation auc = 0.671222
Epoch 505
Validation auc = 0.670020
Epoch 506
Validation auc = 0.668872
Epoch 507
Validation auc = 0.664170
Epoch 508
Validation auc = 0.662421
Epoch 509
Loss = 1.5799e-01, PNorm = 91.4940, GNorm = 0.9349, lr_0 = 9.7550e-04
Validation auc = 0.670293
Epoch 510
Validation auc = 0.702110
Epoch 511
Validation auc = 0.724634
Epoch 512
Validation auc = 0.720643
Epoch 513
Validation auc = 0.635332
Epoch 514
Loss = 8.4471e-01, PNorm = 91.6386, GNorm = 11.4063, lr_0 = 9.7524e-04
Validation auc = 0.720534
Epoch 515
Validation auc = 0.715832
Epoch 516
Validation auc = 0.693637
Epoch 517
Validation auc = 0.651378
Epoch 518
Loss = 9.2997e-02, PNorm = 91.8475, GNorm = 2.0979, lr_0 = 9.7502e-04
Loss = 5.7786e-03, PNorm = 91.8669, GNorm = 0.0880, lr_0 = 9.7500e-04
Validation auc = 0.646293
Epoch 519
Validation auc = 0.644763
Epoch 520
Validation auc = 0.645583
Epoch 521
Validation auc = 0.650612
Epoch 522
Validation auc = 0.654439
Epoch 523
Loss = 8.3257e-02, PNorm = 92.0834, GNorm = 1.0158, lr_0 = 9.7476e-04
Loss = 1.7544e-02, PNorm = 92.0934, GNorm = 0.2009, lr_0 = 9.7474e-04
Validation auc = 0.655150
Epoch 524
Validation auc = 0.657829
Epoch 525
Validation auc = 0.656626
Epoch 526
Validation auc = 0.659523
Epoch 527
Validation auc = 0.663787
Epoch 528
Loss = 2.9063e-03, PNorm = 92.1987, GNorm = 0.0595, lr_0 = 9.7452e-04
Validation auc = 0.666084
Epoch 529
Validation auc = 0.666412
Epoch 530
Validation auc = 0.666248
Epoch 531
Validation auc = 0.668708
Epoch 532
Validation auc = 0.673956
Epoch 533
Loss = 1.1090e-02, PNorm = 92.2963, GNorm = 0.5993, lr_0 = 9.7426e-04
Validation auc = 0.674175
Epoch 534
Validation auc = 0.677400
Epoch 535
Validation auc = 0.676252
Epoch 536
Validation auc = 0.674448
Epoch 537
Loss = 1.6679e-02, PNorm = 92.3706, GNorm = 0.0461, lr_0 = 9.7403e-04
Loss = 2.5504e-03, PNorm = 92.3774, GNorm = 0.1361, lr_0 = 9.7401e-04
Validation auc = 0.668544
Epoch 538
Validation auc = 0.663569
Epoch 539
Validation auc = 0.660398
Epoch 540
Validation auc = 0.661874
Epoch 541
Validation auc = 0.669637
Epoch 542
Loss = 5.9286e-03, PNorm = 92.4614, GNorm = 0.2440, lr_0 = 9.7379e-04
Validation auc = 0.674339
Epoch 543
Validation auc = 0.676853
Epoch 544
Validation auc = 0.679751
Epoch 545
Validation auc = 0.681719
Epoch 546
Validation auc = 0.686092
Epoch 547
Loss = 1.8141e-03, PNorm = 92.5325, GNorm = 0.0232, lr_0 = 9.7353e-04
Validation auc = 0.689646
Epoch 548
Validation auc = 0.693363
Epoch 549
Validation auc = 0.696971
Epoch 550
Validation auc = 0.697463
Epoch 551
Loss = 1.1658e-02, PNorm = 92.5650, GNorm = 0.6242, lr_0 = 9.7331e-04
Loss = 9.9749e-03, PNorm = 92.5676, GNorm = 0.2333, lr_0 = 9.7329e-04
Validation auc = 0.698119
Epoch 552
Validation auc = 0.694894
Epoch 553
Validation auc = 0.689482
Epoch 554
Validation auc = 0.698557
Epoch 555
Validation auc = 0.711240
Epoch 556
Loss = 3.7035e-02, PNorm = 92.6254, GNorm = 0.5642, lr_0 = 9.7305e-04
Loss = 8.5253e-02, PNorm = 92.6321, GNorm = 0.9866, lr_0 = 9.7303e-04
Validation auc = 0.718292
Epoch 557
Validation auc = 0.720971
Epoch 558
Validation auc = 0.719222
Epoch 559
Validation auc = 0.718019
Epoch 560
Validation auc = 0.715777
Epoch 561
Loss = 1.2108e-02, PNorm = 92.6989, GNorm = 0.2483, lr_0 = 9.7281e-04
Validation auc = 0.713481
Epoch 562
Validation auc = 0.716105
Epoch 563
Validation auc = 0.720643
Epoch 564
Validation auc = 0.722556
Epoch 565
Validation auc = 0.726000
Epoch 566
Loss = 4.4983e-03, PNorm = 92.7942, GNorm = 0.1134, lr_0 = 9.7255e-04
Validation auc = 0.732779
Epoch 567
Validation auc = 0.737372
Epoch 568
Validation auc = 0.738848
Epoch 569
Validation auc = 0.741144
Epoch 570
Loss = 8.2987e-04, PNorm = 92.8569, GNorm = 0.0145, lr_0 = 9.7232e-04
Loss = 2.7168e-03, PNorm = 92.8605, GNorm = 0.0756, lr_0 = 9.7231e-04
Validation auc = 0.742456
Epoch 571
Validation auc = 0.743713
Epoch 572
Validation auc = 0.743549
Epoch 573
Validation auc = 0.741690
Epoch 574
Validation auc = 0.740816
Epoch 575
Loss = 1.5849e-02, PNorm = 92.8960, GNorm = 1.1184, lr_0 = 9.7208e-04
Validation auc = 0.738793
Epoch 576
Validation auc = 0.737864
Epoch 577
Validation auc = 0.740105
Epoch 578
Validation auc = 0.744205
Epoch 579
Validation auc = 0.744424
Epoch 580
Loss = 4.7729e-02, PNorm = 92.9344, GNorm = 0.3373, lr_0 = 9.7182e-04
Validation auc = 0.739340
Epoch 581
Validation auc = 0.739996
Epoch 582
Validation auc = 0.750929
Epoch 583
Validation auc = 0.760387
Epoch 584
Loss = 3.6905e-02, PNorm = 93.0087, GNorm = 1.8874, lr_0 = 9.7160e-04
Loss = 1.0205e-03, PNorm = 93.0144, GNorm = 0.0344, lr_0 = 9.7158e-04
Validation auc = 0.763886
Epoch 585
Validation auc = 0.764651
Epoch 586
Validation auc = 0.766729
Epoch 587
Validation auc = 0.766893
Epoch 588
Validation auc = 0.768587
Epoch 589
Loss = 1.3323e-03, PNorm = 93.0820, GNorm = 0.0201, lr_0 = 9.7134e-04
Loss = 2.0658e-02, PNorm = 93.0854, GNorm = 1.1153, lr_0 = 9.7132e-04
Validation auc = 0.769954
Epoch 590
Validation auc = 0.773289
Epoch 591
Validation auc = 0.775476
Epoch 592
Validation auc = 0.776186
Epoch 593
Validation auc = 0.776077
Epoch 594
Loss = 5.6090e-04, PNorm = 93.1258, GNorm = 0.0153, lr_0 = 9.7110e-04
Validation auc = 0.775093
Epoch 595
Validation auc = 0.774328
Epoch 596
Validation auc = 0.772195
Epoch 597
Validation auc = 0.771649
Epoch 598
Validation auc = 0.769462
Epoch 599
Loss = 1.1896e-03, PNorm = 93.1466, GNorm = 0.0324, lr_0 = 9.7084e-04
Validation auc = 0.768478
Epoch 600
Validation auc = 0.768806
Epoch 601
Validation auc = 0.770501
Epoch 602
Validation auc = 0.771375
Epoch 603
Loss = 2.8938e-03, PNorm = 93.1770, GNorm = 0.1358, lr_0 = 9.7062e-04
Loss = 7.3927e-04, PNorm = 93.1808, GNorm = 0.0210, lr_0 = 9.7060e-04
Validation auc = 0.771703
Epoch 604
Validation auc = 0.772031
Epoch 605
Validation auc = 0.767603
Epoch 606
Validation auc = 0.763284
Epoch 607
Validation auc = 0.756724
Epoch 608
Loss = 5.2056e-03, PNorm = 93.1994, GNorm = 0.7126, lr_0 = 9.7036e-04
Validation auc = 0.751749
Epoch 609
Validation auc = 0.744970
Epoch 610
Validation auc = 0.738574
Epoch 611
Validation auc = 0.734419
Epoch 612
Validation auc = 0.731577
Epoch 613
Loss = 7.8090e-03, PNorm = 93.2484, GNorm = 0.4088, lr_0 = 9.7012e-04
Validation auc = 0.731085
Epoch 614
Validation auc = 0.729991
Epoch 615
Validation auc = 0.728570
Epoch 616
Validation auc = 0.724962
Epoch 617
Loss = 1.0946e-02, PNorm = 93.2960, GNorm = 0.0358, lr_0 = 9.6990e-04
Loss = 6.1019e-03, PNorm = 93.2997, GNorm = 0.1129, lr_0 = 9.6988e-04
Validation auc = 0.719659
Epoch 618
Validation auc = 0.716707
Epoch 619
Validation auc = 0.716105
Epoch 620
Validation auc = 0.715613
Epoch 621
Validation auc = 0.717144
Epoch 622
Loss = 6.1094e-04, PNorm = 93.3555, GNorm = 0.0337, lr_0 = 9.6964e-04
Loss = 9.7325e-04, PNorm = 93.3592, GNorm = 0.0369, lr_0 = 9.6962e-04
Validation auc = 0.718456
Epoch 623
Validation auc = 0.718784
Epoch 624
Validation auc = 0.718347
Epoch 625
Validation auc = 0.720096
Epoch 626
Validation auc = 0.721408
Epoch 627
Loss = 1.2080e-02, PNorm = 93.3793, GNorm = 0.7109, lr_0 = 9.6940e-04
Validation auc = 0.723212
Epoch 628
Validation auc = 0.723322
Epoch 629
Validation auc = 0.726219
Epoch 630
Validation auc = 0.722010
Epoch 631
Validation auc = 0.720807
Epoch 632
Loss = 3.0382e-04, PNorm = 93.4448, GNorm = 0.0057, lr_0 = 9.6914e-04
Validation auc = 0.718948
Epoch 633
Validation auc = 0.714684
Epoch 634
Validation auc = 0.711021
Epoch 635
Validation auc = 0.709053
Epoch 636
Loss = 2.3936e-02, PNorm = 93.4685, GNorm = 2.6092, lr_0 = 9.6892e-04
Loss = 5.4075e-05, PNorm = 93.4709, GNorm = 0.0023, lr_0 = 9.6890e-04
Validation auc = 0.708233
Epoch 637
Validation auc = 0.707468
Epoch 638
Validation auc = 0.701345
Epoch 639
Validation auc = 0.705773
Epoch 640
Validation auc = 0.710092
Epoch 641
Loss = 2.6231e-02, PNorm = 93.5251, GNorm = 0.1153, lr_0 = 9.6866e-04
Validation auc = 0.712279
Epoch 642
Validation auc = 0.716761
Epoch 643
Validation auc = 0.719714
Epoch 644
Validation auc = 0.721299
Epoch 645
Validation auc = 0.720643
Epoch 646
Loss = 2.1511e-04, PNorm = 93.5801, GNorm = 0.0060, lr_0 = 9.6842e-04
Validation auc = 0.719987
Epoch 647
Validation auc = 0.719550
Epoch 648
Validation auc = 0.719003
Epoch 649
Validation auc = 0.717581
Epoch 650
Loss = 6.6373e-02, PNorm = 93.5927, GNorm = 0.0094, lr_0 = 9.6820e-04
Loss = 9.7131e-04, PNorm = 93.5916, GNorm = 0.0369, lr_0 = 9.6818e-04
Validation auc = 0.717363
Epoch 651
Validation auc = 0.717035
Epoch 652
Validation auc = 0.715777
Epoch 653
Validation auc = 0.713809
Epoch 654
Validation auc = 0.711185
Epoch 655
Loss = 5.9657e-02, PNorm = 93.6063, GNorm = 0.6467, lr_0 = 9.6794e-04
Loss = 7.0504e-05, PNorm = 93.6063, GNorm = 0.0043, lr_0 = 9.6792e-04
Validation auc = 0.707194
Epoch 656
Validation auc = 0.704680
Epoch 657
Validation auc = 0.701837
Epoch 658
Validation auc = 0.699049
Epoch 659
Validation auc = 0.709490
Epoch 660
Loss = 1.2218e-03, PNorm = 93.6257, GNorm = 0.0222, lr_0 = 9.6770e-04
Validation auc = 0.718620
Epoch 661
Validation auc = 0.723978
Epoch 662
Validation auc = 0.727750
Epoch 663
Validation auc = 0.730538
Epoch 664
Validation auc = 0.733763
Epoch 665
Loss = 2.5664e-02, PNorm = 93.6771, GNorm = 1.1254, lr_0 = 9.6744e-04
Validation auc = 0.735677
Epoch 666
Validation auc = 0.736278
Epoch 667
Validation auc = 0.736497
Epoch 668
Validation auc = 0.736934
Epoch 669
Loss = 2.7175e-03, PNorm = 93.7090, GNorm = 0.5269, lr_0 = 9.6722e-04
Loss = 9.2426e-04, PNorm = 93.7110, GNorm = 0.0360, lr_0 = 9.6720e-04
Validation auc = 0.736497
Epoch 670
Validation auc = 0.736716
Epoch 671
Validation auc = 0.736223
Epoch 672
Validation auc = 0.735950
Epoch 673
Validation auc = 0.732178
Epoch 674
Loss = 6.4700e-04, PNorm = 93.7192, GNorm = 0.0187, lr_0 = 9.6696e-04
Validation auc = 0.730757
Epoch 675
Validation auc = 0.729007
Epoch 676
Validation auc = 0.725508
Epoch 677
Validation auc = 0.723103
Epoch 678
Validation auc = 0.720807
Epoch 679
Loss = 2.5095e-03, PNorm = 93.7241, GNorm = 0.0576, lr_0 = 9.6672e-04
Validation auc = 0.718128
Epoch 680
Validation auc = 0.716925
Epoch 681
Validation auc = 0.717144
Epoch 682
Validation auc = 0.719440
Epoch 683
Loss = 2.4880e-03, PNorm = 93.7430, GNorm = 0.0040, lr_0 = 9.6648e-04
Validation auc = 0.720151
Epoch 684
Validation auc = 0.721463
Epoch 685
Validation auc = 0.723048
Epoch 686
Validation auc = 0.723595
Epoch 687
Validation auc = 0.723923
Epoch 688
Loss = 3.3172e-04, PNorm = 93.7639, GNorm = 0.0055, lr_0 = 9.6624e-04
Loss = 6.1392e-06, PNorm = 93.7653, GNorm = 0.0003, lr_0 = 9.6622e-04
Validation auc = 0.724251
Epoch 689
Validation auc = 0.716433
Epoch 690
Validation auc = 0.708178
Epoch 691
Validation auc = 0.708506
Epoch 692
Validation auc = 0.712388
Epoch 693
Loss = 4.8072e-04, PNorm = 93.7852, GNorm = 0.0141, lr_0 = 9.6600e-04
Validation auc = 0.715449
Epoch 694
Validation auc = 0.716980
Epoch 695
Validation auc = 0.718839
Epoch 696
Validation auc = 0.717581
Epoch 697
Validation auc = 0.715941
Epoch 698
Loss = 2.4539e-04, PNorm = 93.7980, GNorm = 0.0143, lr_0 = 9.6574e-04
Validation auc = 0.714739
Epoch 699
Validation auc = 0.714301
Epoch 700
Validation auc = 0.715449
Epoch 701
Validation auc = 0.716652
Epoch 702
Loss = 2.3412e-02, PNorm = 93.8059, GNorm = 0.0101, lr_0 = 9.6552e-04
Loss = 1.7430e-04, PNorm = 93.8063, GNorm = 0.0125, lr_0 = 9.6550e-04
Validation auc = 0.724688
Epoch 703
Validation auc = 0.719440
Epoch 704
Validation auc = 0.712880
Epoch 705
Validation auc = 0.712989
Epoch 706
Validation auc = 0.710365
Epoch 707
Loss = 3.2702e-02, PNorm = 93.8325, GNorm = 3.2048, lr_0 = 9.6526e-04
Loss = 3.6861e-03, PNorm = 93.8383, GNorm = 0.1379, lr_0 = 9.6525e-04
Validation auc = 0.704680
Epoch 708
Validation auc = 0.703204
Epoch 709
Validation auc = 0.703586
Epoch 710
Validation auc = 0.703805
Epoch 711
Validation auc = 0.699923
Epoch 712
Loss = 6.4252e-03, PNorm = 93.9089, GNorm = 0.3415, lr_0 = 9.6502e-04
Validation auc = 0.691340
Epoch 713
Validation auc = 0.696206
Epoch 714
Validation auc = 0.712279
Epoch 715
Validation auc = 0.721900
Epoch 716
Loss = 7.3553e-04, PNorm = 93.9754, GNorm = 0.0208, lr_0 = 9.6479e-04
Validation auc = 0.730921
Epoch 717
Validation auc = 0.735021
Epoch 718
Validation auc = 0.737153
Epoch 719
Validation auc = 0.736770
Epoch 720
Validation auc = 0.736880
Epoch 721
Loss = 4.1771e-02, PNorm = 93.9805, GNorm = 0.9017, lr_0 = 9.6455e-04
Loss = 1.4046e-03, PNorm = 93.9793, GNorm = 0.0313, lr_0 = 9.6453e-04
Validation auc = 0.731030
Epoch 722
Validation auc = 0.725126
Epoch 723
Validation auc = 0.722010
Epoch 724
Validation auc = 0.722775
Epoch 725
Validation auc = 0.725508
Epoch 726
Loss = 1.5089e-02, PNorm = 93.9975, GNorm = 0.3657, lr_0 = 9.6431e-04
Validation auc = 0.728242
Epoch 727
Validation auc = 0.731413
Epoch 728
Validation auc = 0.733381
Epoch 729
Validation auc = 0.738520
Epoch 730
Validation auc = 0.738793
Epoch 731
Loss = 1.1359e-03, PNorm = 94.0306, GNorm = 0.0184, lr_0 = 9.6405e-04
Validation auc = 0.737645
Epoch 732
Validation auc = 0.736169
Epoch 733
Validation auc = 0.736005
Epoch 734
Validation auc = 0.734857
Epoch 735
Loss = 3.4847e-03, PNorm = 94.0451, GNorm = 0.0207, lr_0 = 9.6383e-04
Loss = 4.0199e-04, PNorm = 94.0463, GNorm = 0.0113, lr_0 = 9.6381e-04
Validation auc = 0.734693
Epoch 736
Validation auc = 0.735130
Epoch 737
Validation auc = 0.734693
Epoch 738
Validation auc = 0.735185
Epoch 739
Validation auc = 0.736497
Epoch 740
Loss = 2.4847e-02, PNorm = 94.0645, GNorm = 0.6368, lr_0 = 9.6357e-04
Loss = 2.4640e-04, PNorm = 94.0656, GNorm = 0.0105, lr_0 = 9.6355e-04
Validation auc = 0.735622
Epoch 741
Validation auc = 0.734365
Epoch 742
Validation auc = 0.734146
Epoch 743
Validation auc = 0.733927
Epoch 744
Validation auc = 0.735075
Epoch 745
Loss = 1.2073e-03, PNorm = 94.0882, GNorm = 0.0478, lr_0 = 9.6333e-04
Validation auc = 0.734365
Epoch 746
Validation auc = 0.733818
Epoch 747
Validation auc = 0.735130
Epoch 748
Validation auc = 0.739394
Epoch 749
Loss = 1.1876e-02, PNorm = 94.1192, GNorm = 0.0055, lr_0 = 9.6309e-04
Validation auc = 0.742620
Epoch 750
Validation auc = 0.743494
Epoch 751
Validation auc = 0.743549
Epoch 752
Validation auc = 0.743713
Epoch 753
Validation auc = 0.744096
Epoch 754
Loss = 3.3805e-02, PNorm = 94.1490, GNorm = 4.6972, lr_0 = 9.6285e-04
Loss = 1.8295e-04, PNorm = 94.1512, GNorm = 0.0067, lr_0 = 9.6284e-04
Validation auc = 0.746228
Epoch 755
Validation auc = 0.749125
Epoch 756
Validation auc = 0.747103
Epoch 757
Validation auc = 0.738574
Epoch 758
Validation auc = 0.732561
Epoch 759
Loss = 3.3440e-04, PNorm = 94.2351, GNorm = 0.0150, lr_0 = 9.6262e-04
Validation auc = 0.730702
Epoch 760
Validation auc = 0.730757
Epoch 761
Validation auc = 0.729663
Epoch 762
Validation auc = 0.722939
Epoch 763
Validation auc = 0.716707
Epoch 764
Loss = 2.4640e-02, PNorm = 94.3303, GNorm = 1.9669, lr_0 = 9.6236e-04
Validation auc = 0.714903
Epoch 765
Validation auc = 0.712224
Epoch 766
Validation auc = 0.710748
Epoch 767
Validation auc = 0.694074
Epoch 768
Loss = 1.4883e-02, PNorm = 94.4002, GNorm = 0.0164, lr_0 = 9.6214e-04
Loss = 6.1847e-04, PNorm = 94.4053, GNorm = 0.0191, lr_0 = 9.6212e-04
Validation auc = 0.688662
Epoch 769
Validation auc = 0.687787
Epoch 770
Validation auc = 0.683687
Epoch 771
Validation auc = 0.678657
Epoch 772
Validation auc = 0.692543
Epoch 773
Loss = 2.1969e-02, PNorm = 94.4668, GNorm = 0.9799, lr_0 = 9.6188e-04
Loss = 9.2374e-01, PNorm = 94.4783, GNorm = 16.3874, lr_0 = 9.6186e-04
Validation auc = 0.722119
Epoch 774
Validation auc = 0.748743
Epoch 775
Validation auc = 0.745353
Epoch 776
Validation auc = 0.759731
Epoch 777
Validation auc = 0.780833
Epoch 778
Loss = 1.0562e-01, PNorm = 94.8586, GNorm = 0.9795, lr_0 = 9.6164e-04
Validation auc = 0.781106
Epoch 779
Validation auc = 0.765307
Epoch 780
Validation auc = 0.743330
Epoch 781
Validation auc = 0.724579
Epoch 782
Validation auc = 0.708725
Epoch 783
Loss = 5.7589e-02, PNorm = 95.3452, GNorm = 0.5878, lr_0 = 9.6139e-04
Validation auc = 0.697573
Epoch 784
Validation auc = 0.692707
Epoch 785
Validation auc = 0.694675
Epoch 786
Validation auc = 0.690411
Epoch 787
Loss = 4.0888e-02, PNorm = 95.5808, GNorm = 2.1685, lr_0 = 9.6117e-04
Loss = 7.8132e-05, PNorm = 95.5930, GNorm = 0.0036, lr_0 = 9.6115e-04
Validation auc = 0.691559
Epoch 788
Validation auc = 0.702056
Epoch 789
Validation auc = 0.699103
Epoch 790
Validation auc = 0.701728
Epoch 791
Validation auc = 0.702493
Epoch 792
Loss = 7.2888e-02, PNorm = 95.7475, GNorm = 1.2912, lr_0 = 9.6093e-04
Validation auc = 0.705445
Epoch 793
Validation auc = 0.707850
Epoch 794
Validation auc = 0.713481
Epoch 795
Validation auc = 0.715668
Epoch 796
Validation auc = 0.715176
Epoch 797
Loss = 1.8297e-02, PNorm = 95.9232, GNorm = 0.2422, lr_0 = 9.6067e-04
Validation auc = 0.714192
Epoch 798
Validation auc = 0.715996
Epoch 799
Validation auc = 0.726274
Epoch 800
Validation auc = 0.729390
Epoch 801
Loss = 1.9581e-02, PNorm = 96.1128, GNorm = 0.6283, lr_0 = 9.6045e-04
Loss = 1.9516e-04, PNorm = 96.1369, GNorm = 0.0042, lr_0 = 9.6043e-04
Validation auc = 0.716215
Epoch 802
Validation auc = 0.717199
Epoch 803
Validation auc = 0.709928
Epoch 804
Validation auc = 0.709272
Epoch 805
Validation auc = 0.715832
Epoch 806
Loss = 8.2428e-02, PNorm = 96.4261, GNorm = 1.4945, lr_0 = 9.6019e-04
Loss = 4.2461e-03, PNorm = 96.4458, GNorm = 0.1135, lr_0 = 9.6018e-04
Validation auc = 0.722283
Epoch 807
Validation auc = 0.721135
Epoch 808
Validation auc = 0.723923
Epoch 809
Validation auc = 0.729445
Epoch 810
Validation auc = 0.731959
Epoch 811
Loss = 7.7258e-03, PNorm = 96.6497, GNorm = 0.1720, lr_0 = 9.5996e-04
Validation auc = 0.733927
Epoch 812
Validation auc = 0.736387
Epoch 813
Validation auc = 0.734365
Epoch 814
Validation auc = 0.729554
Epoch 815
Validation auc = 0.721572
Epoch 816
Loss = 2.6940e-03, PNorm = 96.7899, GNorm = 0.0704, lr_0 = 9.5970e-04
Validation auc = 0.707850
Epoch 817
Validation auc = 0.694730
Epoch 818
Validation auc = 0.682921
Epoch 819
Validation auc = 0.672589
Epoch 820
Loss = 5.1202e-04, PNorm = 96.9619, GNorm = 0.0369, lr_0 = 9.5948e-04
Loss = 9.9744e-01, PNorm = 96.9679, GNorm = 12.8259, lr_0 = 9.5946e-04
Validation auc = 0.662694
Epoch 821
Validation auc = 0.650612
Epoch 822
Validation auc = 0.648152
Epoch 823
Validation auc = 0.658703
Epoch 824
Validation auc = 0.667396
Epoch 825
Loss = 1.3601e-01, PNorm = 97.2131, GNorm = 2.1244, lr_0 = 9.5924e-04
Validation auc = 0.678876
Epoch 826
Validation auc = 0.684398
Epoch 827
Validation auc = 0.684015
Epoch 828
Validation auc = 0.682265
Epoch 829
Validation auc = 0.679368
Epoch 830
Loss = 1.2312e-02, PNorm = 97.4235, GNorm = 0.2917, lr_0 = 9.5899e-04
Validation auc = 0.679915
Epoch 831
Validation auc = 0.679532
Epoch 832
Validation auc = 0.679805
Epoch 833
Validation auc = 0.680899
Epoch 834
Loss = 6.0576e-03, PNorm = 97.5315, GNorm = 0.0933, lr_0 = 9.5877e-04
Loss = 3.7377e-03, PNorm = 97.5389, GNorm = 0.2424, lr_0 = 9.5875e-04
Validation auc = 0.680571
Epoch 835
Validation auc = 0.681828
Epoch 836
Validation auc = 0.683031
Epoch 837
Validation auc = 0.683250
Epoch 838
Validation auc = 0.684179
Epoch 839
Loss = 1.7536e-03, PNorm = 97.6203, GNorm = 0.0804, lr_0 = 9.5851e-04
Loss = 1.0066e-03, PNorm = 97.6246, GNorm = 0.0268, lr_0 = 9.5849e-04
Validation auc = 0.684398
Epoch 840
Validation auc = 0.684288
Epoch 841
Validation auc = 0.685874
Epoch 842
Validation auc = 0.686256
Epoch 843
Validation auc = 0.682976
Epoch 844
Loss = 3.3729e-03, PNorm = 97.6661, GNorm = 0.1993, lr_0 = 9.5827e-04
Validation auc = 0.681937
Epoch 845
Validation auc = 0.680133
Epoch 846
Validation auc = 0.682539
Epoch 847
Validation auc = 0.684671
Epoch 848
Validation auc = 0.685710
Epoch 849
Loss = 4.9207e-04, PNorm = 97.7123, GNorm = 0.0093, lr_0 = 9.5802e-04
Validation auc = 0.686256
Epoch 850
Validation auc = 0.687568
Epoch 851
Validation auc = 0.690794
Epoch 852
Validation auc = 0.694730
Epoch 853
Loss = 6.4065e-04, PNorm = 97.7300, GNorm = 0.0348, lr_0 = 9.5780e-04
Loss = 4.8802e-04, PNorm = 97.7313, GNorm = 0.0174, lr_0 = 9.5778e-04
Validation auc = 0.697026
Epoch 854
Validation auc = 0.697135
Epoch 855
Validation auc = 0.695441
Epoch 856
Validation auc = 0.693691
Epoch 857
Validation auc = 0.691942
Epoch 858
Loss = 4.7505e-03, PNorm = 97.7548, GNorm = 0.4844, lr_0 = 9.5754e-04
Validation auc = 0.687623
Epoch 859
Validation auc = 0.684780
Epoch 860
Validation auc = 0.683414
Epoch 861
Validation auc = 0.682539
Epoch 862
Validation auc = 0.682867
Epoch 863
Loss = 6.4176e-04, PNorm = 97.8018, GNorm = 0.0120, lr_0 = 9.5730e-04
Validation auc = 0.682867
Epoch 864
Validation auc = 0.684780
Epoch 865
Validation auc = 0.683906
Epoch 866
Validation auc = 0.678493
Epoch 867
Loss = 1.2511e-02, PNorm = 97.8392, GNorm = 0.1187, lr_0 = 9.5708e-04
Loss = 1.3022e-03, PNorm = 97.8444, GNorm = 0.0597, lr_0 = 9.5707e-04
Validation auc = 0.678001
Epoch 868
Validation auc = 0.677455
Epoch 869
Validation auc = 0.678111
Epoch 870
Validation auc = 0.678275
Epoch 871
Validation auc = 0.678001
Epoch 872
Loss = 2.4647e-03, PNorm = 97.9251, GNorm = 0.0789, lr_0 = 9.5683e-04
Loss = 1.9445e-04, PNorm = 97.9300, GNorm = 0.0070, lr_0 = 9.5681e-04
Validation auc = 0.678657
Epoch 873
Validation auc = 0.681172
Epoch 874
Validation auc = 0.681391
Epoch 875
Validation auc = 0.683687
Epoch 876
Validation auc = 0.684562
Epoch 877
Loss = 6.4259e-03, PNorm = 97.9828, GNorm = 0.2974, lr_0 = 9.5659e-04
Validation auc = 0.685874
Epoch 878
Validation auc = 0.687896
Epoch 879
Validation auc = 0.691122
Epoch 880
Validation auc = 0.692215
Epoch 881
Validation auc = 0.693910
Epoch 882
Loss = 7.5972e-02, PNorm = 98.0352, GNorm = 0.8365, lr_0 = 9.5634e-04
Validation auc = 0.692543
Epoch 883
Validation auc = 0.691176
Epoch 884
Validation auc = 0.688170
Epoch 885
Validation auc = 0.694347
Epoch 886
Loss = 1.2797e-03, PNorm = 98.0730, GNorm = 0.0118, lr_0 = 9.5612e-04
Loss = 9.9493e-05, PNorm = 98.0785, GNorm = 0.0036, lr_0 = 9.5610e-04
Validation auc = 0.709654
Epoch 887
Validation auc = 0.723595
Epoch 888
Validation auc = 0.731686
Epoch 889
Validation auc = 0.727969
Epoch 890
Validation auc = 0.721080
Epoch 891
Loss = 1.3505e-03, PNorm = 98.1348, GNorm = 0.0966, lr_0 = 9.5586e-04
Validation auc = 0.713591
Epoch 892
Validation auc = 0.710693
Epoch 893
Validation auc = 0.713153
Epoch 894
Validation auc = 0.712716
Epoch 895
Validation auc = 0.713372
Epoch 896
Loss = 1.9398e-03, PNorm = 98.1645, GNorm = 0.0634, lr_0 = 9.5563e-04
Validation auc = 0.715231
Epoch 897
Validation auc = 0.712005
Epoch 898
Validation auc = 0.712060
Epoch 899
Validation auc = 0.711459
Epoch 900
Loss = 9.9663e-04, PNorm = 98.1954, GNorm = 0.0057, lr_0 = 9.5541e-04
Loss = 3.7282e-04, PNorm = 98.1975, GNorm = 0.0098, lr_0 = 9.5539e-04
Validation auc = 0.712279
Epoch 901
Validation auc = 0.711787
Epoch 902
Validation auc = 0.710584
Epoch 903
Validation auc = 0.709053
Epoch 904
Validation auc = 0.705664
Epoch 905
Loss = 8.5152e-02, PNorm = 98.2145, GNorm = 1.1377, lr_0 = 9.5515e-04
Loss = 5.6227e-04, PNorm = 98.2155, GNorm = 0.0199, lr_0 = 9.5513e-04
Validation auc = 0.697354
Epoch 906
Validation auc = 0.703368
Epoch 907
Validation auc = 0.720424
Epoch 908
Validation auc = 0.734146
Epoch 909
Validation auc = 0.740843
Epoch 910
Loss = 1.3295e+00, PNorm = 98.2688, GNorm = 9.2265, lr_0 = 9.5491e-04
Validation auc = 0.691997
Epoch 911
Validation auc = 0.696315
Epoch 912
Validation auc = 0.702329
Epoch 913
Validation auc = 0.708889
Epoch 914
Validation auc = 0.703805
Epoch 915
Loss = 1.1331e-01, PNorm = 98.3711, GNorm = 3.5860, lr_0 = 9.5466e-04
Validation auc = 0.702712
Epoch 916
Validation auc = 0.705500
Epoch 917
Validation auc = 0.707194
Epoch 918
Validation auc = 0.705773
Epoch 919
Loss = 3.9492e-02, PNorm = 98.5785, GNorm = 0.3838, lr_0 = 9.5444e-04
Loss = 8.5184e-04, PNorm = 98.5943, GNorm = 0.0196, lr_0 = 9.5442e-04
Validation auc = 0.700470
Epoch 920
Validation auc = 0.695058
Epoch 921
Validation auc = 0.692707
Epoch 922
Validation auc = 0.690684
Epoch 923
Validation auc = 0.689864
Epoch 924
Loss = 6.0685e-02, PNorm = 98.8199, GNorm = 0.0423, lr_0 = 9.5419e-04
Validation auc = 0.693363
Epoch 925
Validation auc = 0.695277
Epoch 926
Validation auc = 0.695003
Epoch 927
Validation auc = 0.689700
Epoch 928
Validation auc = 0.684890
Epoch 929
Loss = 5.4832e-02, PNorm = 98.9857, GNorm = 1.3387, lr_0 = 9.5395e-04
Validation auc = 0.682539
Epoch 930
Validation auc = 0.680953
Epoch 931
Validation auc = 0.680680
Epoch 932
Validation auc = 0.682921
Epoch 933
Loss = 1.7422e-03, PNorm = 99.1271, GNorm = 0.0103, lr_0 = 9.5371e-04
Validation auc = 0.685108
Epoch 934
Validation auc = 0.685382
Epoch 935
Validation auc = 0.685655
Epoch 936
Validation auc = 0.683359
Epoch 937
Validation auc = 0.681445
Epoch 938
Loss = 6.1708e-04, PNorm = 99.2230, GNorm = 0.0114, lr_0 = 9.5348e-04
Loss = 8.2569e-04, PNorm = 99.2298, GNorm = 0.0162, lr_0 = 9.5346e-04
Validation auc = 0.679423
Epoch 939
Validation auc = 0.679751
Epoch 940
Validation auc = 0.679477
Epoch 941
Validation auc = 0.676799
Epoch 942
Validation auc = 0.674831
Epoch 943
Loss = 1.0374e-02, PNorm = 99.2879, GNorm = 0.6636, lr_0 = 9.5324e-04
Validation auc = 0.670894
Epoch 944
Validation auc = 0.669418
Epoch 945
Validation auc = 0.669692
Epoch 946
Validation auc = 0.669582
Epoch 947
Validation auc = 0.664717
Epoch 948
Loss = 4.8648e-04, PNorm = 99.3693, GNorm = 0.0164, lr_0 = 9.5299e-04
Validation auc = 0.661601
Epoch 949
Validation auc = 0.658266
Epoch 950
Validation auc = 0.661765
Epoch 951
Validation auc = 0.663405
Epoch 952
Loss = 9.6715e-03, PNorm = 99.4657, GNorm = 0.5371, lr_0 = 9.5277e-04
Loss = 2.9754e-04, PNorm = 99.4740, GNorm = 0.0078, lr_0 = 9.5275e-04
Validation auc = 0.665865
Epoch 953
Validation auc = 0.670512
Epoch 954
Validation auc = 0.676853
Epoch 955
Validation auc = 0.682539
Epoch 956
Validation auc = 0.689208
Epoch 957
Loss = 1.0373e-02, PNorm = 99.5776, GNorm = 1.1442, lr_0 = 9.5251e-04
Loss = 7.4338e-05, PNorm = 99.5842, GNorm = 0.0023, lr_0 = 9.5250e-04
Validation auc = 0.691559
Epoch 958
Validation auc = 0.694129
Epoch 959
Validation auc = 0.695386
Epoch 960
Validation auc = 0.696261
Epoch 961
Validation auc = 0.697354
Epoch 962
Loss = 2.1086e-04, PNorm = 99.6462, GNorm = 0.0043, lr_0 = 9.5228e-04
Validation auc = 0.694785
Epoch 963
Validation auc = 0.690630
Epoch 964
Validation auc = 0.687896
Epoch 965
Validation auc = 0.687022
Epoch 966
Loss = 1.7821e-02, PNorm = 99.6712, GNorm = 0.0110, lr_0 = 9.5204e-04
Validation auc = 0.688771
Epoch 967
Validation auc = 0.691778
Epoch 968
Validation auc = 0.691832
Epoch 969
Validation auc = 0.692817
Epoch 970
Validation auc = 0.693090
Epoch 971
Loss = 1.4945e-02, PNorm = 99.6898, GNorm = 0.0093, lr_0 = 9.5180e-04
Loss = 1.5644e-03, PNorm = 99.6926, GNorm = 0.0431, lr_0 = 9.5179e-04
Validation auc = 0.700689
Epoch 972
Validation auc = 0.705281
Epoch 973
Validation auc = 0.707358
Epoch 974
Validation auc = 0.708178
Epoch 975
Validation auc = 0.708069
Epoch 976
Loss = 3.7165e-04, PNorm = 99.7342, GNorm = 0.0092, lr_0 = 9.5157e-04
Validation auc = 0.708124
Epoch 977
Validation auc = 0.706484
Epoch 978
Validation auc = 0.704461
Epoch 979
Validation auc = 0.706648
Epoch 980
Validation auc = 0.706921
Epoch 981
Loss = 9.7710e-03, PNorm = 99.8229, GNorm = 1.2447, lr_0 = 9.5132e-04
Validation auc = 0.706921
Epoch 982
Validation auc = 0.706210
Epoch 983
Validation auc = 0.706702
Epoch 984
Validation auc = 0.706429
Epoch 985
Loss = 8.0815e-04, PNorm = 99.9065, GNorm = 0.1146, lr_0 = 9.5110e-04
Loss = 8.0002e-05, PNorm = 99.9104, GNorm = 0.0019, lr_0 = 9.5108e-04
Validation auc = 0.706320
Epoch 986
Validation auc = 0.694129
Epoch 987
Validation auc = 0.687131
Epoch 988
Validation auc = 0.684726
Epoch 989
Validation auc = 0.682757
Epoch 990
Loss = 5.2671e-03, PNorm = 99.9209, GNorm = 0.0368, lr_0 = 9.5084e-04
Loss = 3.3390e-04, PNorm = 99.9237, GNorm = 0.0125, lr_0 = 9.5083e-04
Validation auc = 0.680407
Epoch 991
Validation auc = 0.679587
Epoch 992
Validation auc = 0.675104
Epoch 993
Validation auc = 0.670840
Epoch 994
Validation auc = 0.668489
Epoch 995
Loss = 3.1272e-03, PNorm = 99.9639, GNorm = 0.1389, lr_0 = 9.5061e-04
Validation auc = 0.660453
Epoch 996
Validation auc = 0.656845
Epoch 997
Validation auc = 0.664881
Epoch 998
Validation auc = 0.673190
Epoch 999
Loss = 2.3534e-02, PNorm = 100.0769, GNorm = 0.0262, lr_0 = 9.5037e-04
Validation auc = 0.677345
Epoch 1000
Validation auc = 0.679149
Epoch 1001
Validation auc = 0.679641
Epoch 1002
Validation auc = 0.680789
Epoch 1003
Validation auc = 0.682812
Epoch 1004
Loss = 1.5738e-02, PNorm = 100.1865, GNorm = 0.1754, lr_0 = 9.5014e-04
Loss = 2.4384e-01, PNorm = 100.1920, GNorm = 2.8270, lr_0 = 9.5012e-04
Validation auc = 0.682047
Epoch 1005
Validation auc = 0.669036
Epoch 1006
Validation auc = 0.657337
Epoch 1007
Validation auc = 0.654822
Epoch 1008
Validation auc = 0.663131
Epoch 1009
Loss = 1.3977e-02, PNorm = 100.3340, GNorm = 0.2003, lr_0 = 9.4990e-04
Validation auc = 0.679641
Epoch 1010
Validation auc = 0.697190
Epoch 1011
Validation auc = 0.706156
Epoch 1012
Validation auc = 0.711677
Epoch 1013
Validation auc = 0.713263
Epoch 1014
Loss = 3.7937e-03, PNorm = 100.4806, GNorm = 0.0712, lr_0 = 9.4965e-04
Validation auc = 0.725563
Epoch 1015
Validation auc = 0.747649
Epoch 1016
Validation auc = 0.755412
Epoch 1017
Validation auc = 0.756888
Epoch 1018
Loss = 2.8088e-02, PNorm = 100.6457, GNorm = 0.1719, lr_0 = 9.4943e-04
Loss = 2.6775e-03, PNorm = 100.6602, GNorm = 0.0412, lr_0 = 9.4941e-04
Validation auc = 0.758692
Epoch 1019
Validation auc = 0.759294
Epoch 1020
Validation auc = 0.758747
Epoch 1021
Validation auc = 0.758856
Epoch 1022
Validation auc = 0.756779
Epoch 1023
Loss = 6.2622e-03, PNorm = 100.8417, GNorm = 0.0432, lr_0 = 9.4918e-04
Loss = 8.0269e-04, PNorm = 100.8532, GNorm = 0.0217, lr_0 = 9.4916e-04
Validation auc = 0.758091
Epoch 1024
Validation auc = 0.756014
Epoch 1025
Validation auc = 0.755139
Epoch 1026
Validation auc = 0.756342
Epoch 1027
Validation auc = 0.757654
Epoch 1028
Loss = 1.0576e-03, PNorm = 100.9599, GNorm = 0.0228, lr_0 = 9.4894e-04
Validation auc = 0.759294
Epoch 1029
Validation auc = 0.759731
Epoch 1030
Validation auc = 0.759840
Epoch 1031
Validation auc = 0.758638
Epoch 1032
Validation auc = 0.758091
Epoch 1033
Loss = 2.3024e-04, PNorm = 101.0381, GNorm = 0.0076, lr_0 = 9.4869e-04
Validation auc = 0.757544
Epoch 1034
Validation auc = 0.756670
Epoch 1035
Validation auc = 0.755139
Epoch 1036
Validation auc = 0.753827
Epoch 1037
Loss = 1.7990e-03, PNorm = 101.0859, GNorm = 0.2285, lr_0 = 9.4847e-04
Loss = 1.7781e-05, PNorm = 101.0891, GNorm = 0.0011, lr_0 = 9.4845e-04
Validation auc = 0.752624
Epoch 1038
Validation auc = 0.752077
Epoch 1039
Validation auc = 0.751585
Epoch 1040
Validation auc = 0.749945
Epoch 1041
Validation auc = 0.746939
Epoch 1042
Loss = 4.4890e-04, PNorm = 101.1307, GNorm = 0.0210, lr_0 = 9.4823e-04
Validation auc = 0.746064
Epoch 1043
Validation auc = 0.744916
Epoch 1044
Validation auc = 0.740105
Epoch 1045
Validation auc = 0.734365
Epoch 1046
Validation auc = 0.729117
Epoch 1047
Loss = 3.1636e-02, PNorm = 101.1899, GNorm = 1.5104, lr_0 = 9.4798e-04
Validation auc = 0.723923
Epoch 1048
Validation auc = 0.717035
Epoch 1049
Validation auc = 0.714739
Epoch 1050
Validation auc = 0.712443
Epoch 1051
Loss = 2.1246e-03, PNorm = 101.2409, GNorm = 0.0939, lr_0 = 9.4776e-04
Loss = 9.1320e-05, PNorm = 101.2442, GNorm = 0.0033, lr_0 = 9.4775e-04
Validation auc = 0.710256
Epoch 1052
Validation auc = 0.709764
Epoch 1053
Validation auc = 0.709490
Epoch 1054
Validation auc = 0.705445
Epoch 1055
Validation auc = 0.702110
Epoch 1056
Loss = 9.6294e-04, PNorm = 101.2872, GNorm = 0.0164, lr_0 = 9.4751e-04
Loss = 2.2954e-04, PNorm = 101.2902, GNorm = 0.0100, lr_0 = 9.4749e-04
Validation auc = 0.699158
Epoch 1057
Validation auc = 0.698229
Epoch 1058
Validation auc = 0.696971
Epoch 1059
Validation auc = 0.695386
Epoch 1060
Validation auc = 0.695823
Epoch 1061
Loss = 1.1317e-03, PNorm = 101.3269, GNorm = 0.0726, lr_0 = 9.4728e-04
Validation auc = 0.695933
Epoch 1062
Validation auc = 0.694238
Epoch 1063
Validation auc = 0.693746
Epoch 1064
Validation auc = 0.693855
Epoch 1065
Validation auc = 0.698174
Epoch 1066
Loss = 7.1496e-03, PNorm = 101.3657, GNorm = 0.4121, lr_0 = 9.4702e-04
Validation auc = 0.700142
Epoch 1067
Validation auc = 0.700525
Epoch 1068
Validation auc = 0.701345
Epoch 1069
Validation auc = 0.699923
Epoch 1070
Loss = 5.1712e-03, PNorm = 101.3984, GNorm = 0.3868, lr_0 = 9.4681e-04
Loss = 6.9372e-05, PNorm = 101.4011, GNorm = 0.0027, lr_0 = 9.4679e-04
Validation auc = 0.697299
Epoch 1071
Validation auc = 0.694074
Epoch 1072
Validation auc = 0.692106
Epoch 1073
Validation auc = 0.689427
Epoch 1074
Validation auc = 0.688443
Epoch 1075
Loss = 7.4924e-05, PNorm = 101.4257, GNorm = 0.0019, lr_0 = 9.4657e-04
Validation auc = 0.688388
Epoch 1076
Validation auc = 0.688279
Epoch 1077
Validation auc = 0.687623
Epoch 1078
Validation auc = 0.687076
Epoch 1079
Validation auc = 0.686584
Epoch 1080
Loss = 8.3464e-02, PNorm = 101.4378, GNorm = 1.1857, lr_0 = 9.4632e-04
Validation auc = 0.687732
Epoch 1081
Validation auc = 0.686694
Epoch 1082
Validation auc = 0.683960
Epoch 1083
Validation auc = 0.682812
Epoch 1084
Loss = 2.7386e-02, PNorm = 101.4684, GNorm = 0.5640, lr_0 = 9.4610e-04
Loss = 3.0266e-04, PNorm = 101.4726, GNorm = 0.0168, lr_0 = 9.4608e-04
Validation auc = 0.685546
Epoch 1085
Validation auc = 0.687131
Epoch 1086
Validation auc = 0.688662
Epoch 1087
Validation auc = 0.691012
Epoch 1088
Validation auc = 0.693254
Epoch 1089
Loss = 1.7632e-04, PNorm = 101.5279, GNorm = 0.0100, lr_0 = 9.4585e-04
Loss = 0.0000e+00, PNorm = 101.5305, GNorm = 0.0000, lr_0 = 9.4583e-04
Validation auc = 0.694293
Epoch 1090
Validation auc = 0.695605
Epoch 1091
Validation auc = 0.698229
Epoch 1092
Validation auc = 0.699267
Epoch 1093
Validation auc = 0.700415
Epoch 1094
Loss = 1.7485e-04, PNorm = 101.5438, GNorm = 0.0073, lr_0 = 9.4561e-04
Validation auc = 0.701181
Epoch 1095
Validation auc = 0.702110
Epoch 1096
Validation auc = 0.702766
Epoch 1097
Validation auc = 0.703368
Epoch 1098
Validation auc = 0.704024
Epoch 1099
Loss = 2.7526e-04, PNorm = 101.5601, GNorm = 0.0100, lr_0 = 9.4536e-04
Validation auc = 0.704297
Epoch 1100
Validation auc = 0.704188
Epoch 1101
Validation auc = 0.704406
Epoch 1102
Validation auc = 0.704789
Epoch 1103
Loss = 5.3148e-04, PNorm = 101.5696, GNorm = 0.0015, lr_0 = 9.4515e-04
Loss = 6.1267e-05, PNorm = 101.5702, GNorm = 0.0032, lr_0 = 9.4513e-04
Validation auc = 0.705336
Epoch 1104
Validation auc = 0.705992
Epoch 1105
Validation auc = 0.706484
Epoch 1106
Validation auc = 0.706866
Epoch 1107
Validation auc = 0.707140
Epoch 1108
Loss = 4.5411e-04, PNorm = 101.5797, GNorm = 0.0034, lr_0 = 9.4489e-04
Validation auc = 0.707030
Epoch 1109
Validation auc = 0.707140
Epoch 1110
Validation auc = 0.707304
Epoch 1111
Validation auc = 0.707413
Epoch 1112
Validation auc = 0.707577
Epoch 1113
Loss = 1.4462e-04, PNorm = 101.5904, GNorm = 0.0063, lr_0 = 9.4466e-04
Validation auc = 0.707741
Epoch 1114
Validation auc = 0.707796
Epoch 1115
Validation auc = 0.707686
Epoch 1116
Validation auc = 0.707522
Epoch 1117
Loss = 5.7138e-05, PNorm = 101.6013, GNorm = 0.0022, lr_0 = 9.4444e-04
Loss = 2.9405e-06, PNorm = 101.6021, GNorm = 0.0001, lr_0 = 9.4443e-04
Validation auc = 0.707577
Epoch 1118
Validation auc = 0.707413
Epoch 1119
Validation auc = 0.707304
Epoch 1120
Validation auc = 0.707358
Epoch 1121
Validation auc = 0.707522
Epoch 1122
Loss = 8.0036e-05, PNorm = 101.6102, GNorm = 0.0083, lr_0 = 9.4419e-04
Loss = 2.7219e-06, PNorm = 101.6106, GNorm = 0.0001, lr_0 = 9.4417e-04
Validation auc = 0.707468
Epoch 1123
Validation auc = 0.707413
Epoch 1124
Validation auc = 0.707413
Epoch 1125
Validation auc = 0.707304
Epoch 1126
Validation auc = 0.707468
Epoch 1127
Loss = 4.5243e-05, PNorm = 101.6150, GNorm = 0.0011, lr_0 = 9.4396e-04
Validation auc = 0.707468
Epoch 1128
Validation auc = 0.707413
Epoch 1129
Validation auc = 0.707522
Epoch 1130
Validation auc = 0.706374
Epoch 1131
Validation auc = 0.705554
Epoch 1132
Loss = 1.8519e-04, PNorm = 101.6187, GNorm = 0.0034, lr_0 = 9.4371e-04
Validation auc = 0.702930
Epoch 1133
Validation auc = 0.700251
Epoch 1134
Validation auc = 0.704242
Epoch 1135
Validation auc = 0.706429
Epoch 1136
Loss = 4.8721e-04, PNorm = 101.6481, GNorm = 0.0500, lr_0 = 9.4349e-04
Loss = 1.0788e-05, PNorm = 101.6512, GNorm = 0.0005, lr_0 = 9.4347e-04
Validation auc = 0.708124
Epoch 1137
Validation auc = 0.709272
Epoch 1138
Validation auc = 0.709983
Epoch 1139
Validation auc = 0.710420
Epoch 1140
Validation auc = 0.710693
Epoch 1141
Loss = 4.3016e-05, PNorm = 101.6789, GNorm = 0.0008, lr_0 = 9.4324e-04
Validation auc = 0.711021
Epoch 1142
Validation auc = 0.713700
Epoch 1143
Validation auc = 0.717035
Epoch 1144
Validation auc = 0.718565
Epoch 1145
Validation auc = 0.721463
Epoch 1146
Loss = 2.4291e-05, PNorm = 101.6998, GNorm = 0.0013, lr_0 = 9.4300e-04
Validation auc = 0.723431
Epoch 1147
Validation auc = 0.723923
Epoch 1148
Validation auc = 0.724415
Epoch 1149
Validation auc = 0.725126
Epoch 1150
Loss = 7.8162e-03, PNorm = 101.7126, GNorm = 0.0042, lr_0 = 9.4279e-04
Loss = 2.7138e-05, PNorm = 101.7147, GNorm = 0.0014, lr_0 = 9.4277e-04
Validation auc = 0.718073
Epoch 1151
Validation auc = 0.714684
Epoch 1152
Validation auc = 0.711513
Epoch 1153
Validation auc = 0.709709
Epoch 1154
Validation auc = 0.708124
Epoch 1155
Loss = 2.1957e-04, PNorm = 101.7493, GNorm = 0.0196, lr_0 = 9.4253e-04
Loss = 2.2054e-06, PNorm = 101.7509, GNorm = 0.0003, lr_0 = 9.4252e-04
Validation auc = 0.705773
Epoch 1156
Validation auc = 0.706538
Epoch 1157
Validation auc = 0.707358
Epoch 1158
Validation auc = 0.708178
Epoch 1159
Validation auc = 0.708124
Epoch 1160
Loss = 3.8620e-04, PNorm = 101.7695, GNorm = 0.0094, lr_0 = 9.4230e-04
Validation auc = 0.708998
Epoch 1161
Validation auc = 0.709983
Epoch 1162
Validation auc = 0.705117
Epoch 1163
Validation auc = 0.699377
Epoch 1164
Validation auc = 0.702056
Epoch 1165
Loss = 1.8650e-04, PNorm = 101.8009, GNorm = 0.0068, lr_0 = 9.4205e-04
Validation auc = 0.702602
Epoch 1166
Validation auc = 0.704352
Epoch 1167
Validation auc = 0.706101
Epoch 1168
Validation auc = 0.704242
Epoch 1169
Loss = 4.4986e-04, PNorm = 101.8421, GNorm = 0.0317, lr_0 = 9.4183e-04
Loss = 1.5800e-04, PNorm = 101.8452, GNorm = 0.0164, lr_0 = 9.4182e-04
Validation auc = 0.698338
Epoch 1170
Validation auc = 0.690520
Epoch 1171
Validation auc = 0.693691
Epoch 1172
Validation auc = 0.691614
Epoch 1173
Validation auc = 0.693527
Epoch 1174
Loss = 5.5911e-04, PNorm = 101.8813, GNorm = 0.0214, lr_0 = 9.4158e-04
Validation auc = 0.694293
Epoch 1175
Validation auc = 0.695277
Epoch 1176
Validation auc = 0.697081
Epoch 1177
Validation auc = 0.697846
Epoch 1178
Validation auc = 0.698502
Epoch 1179
Loss = 2.3869e-03, PNorm = 101.9156, GNorm = 0.1601, lr_0 = 9.4135e-04
Validation auc = 0.699595
Epoch 1180
Validation auc = 0.700853
Epoch 1181
Validation auc = 0.700361
Epoch 1182
Validation auc = 0.701509
Epoch 1183
Loss = 2.2283e-02, PNorm = 101.9297, GNorm = 0.0021, lr_0 = 9.4112e-04
Validation auc = 0.700634
Epoch 1184
Validation auc = 0.701946
Epoch 1185
Validation auc = 0.700908
Epoch 1186
Validation auc = 0.697846
Epoch 1187
Validation auc = 0.696807
Epoch 1188
Loss = 5.4099e-03, PNorm = 101.9516, GNorm = 0.0050, lr_0 = 9.4088e-04
Loss = 1.0271e-04, PNorm = 101.9539, GNorm = 0.0036, lr_0 = 9.4087e-04
Validation auc = 0.695441
Epoch 1189
Validation auc = 0.693746
Epoch 1190
Validation auc = 0.693855
Epoch 1191
Validation auc = 0.693090
Epoch 1192
Validation auc = 0.692981
Epoch 1193
Loss = 2.9080e-05, PNorm = 101.9744, GNorm = 0.0007, lr_0 = 9.4065e-04
Validation auc = 0.693527
Epoch 1194
Validation auc = 0.693855
Epoch 1195
Validation auc = 0.694074
Epoch 1196
Validation auc = 0.694238
Epoch 1197
Validation auc = 0.691176
Epoch 1198
Loss = 2.4386e-04, PNorm = 101.9869, GNorm = 0.0120, lr_0 = 9.4040e-04
Validation auc = 0.687404
Epoch 1199
Validation auc = 0.685272
Epoch 1200
Validation auc = 0.684288
Epoch 1201
Validation auc = 0.683031
Epoch 1202
Loss = 1.2010e-04, PNorm = 101.9944, GNorm = 0.0008, lr_0 = 9.4018e-04
Loss = 2.7834e-05, PNorm = 101.9949, GNorm = 0.0010, lr_0 = 9.4016e-04
Validation auc = 0.680953
Epoch 1203
Validation auc = 0.679204
Epoch 1204
Validation auc = 0.678275
Epoch 1205
Validation auc = 0.677181
Epoch 1206
Validation auc = 0.676853
Epoch 1207
Loss = 2.2313e-03, PNorm = 102.0037, GNorm = 0.6985, lr_0 = 9.3993e-04
Loss = 1.4927e-04, PNorm = 102.0048, GNorm = 0.0048, lr_0 = 9.3991e-04
Validation auc = 0.677455
Epoch 1208
Validation auc = 0.677291
Epoch 1209
Validation auc = 0.677619
Epoch 1210
Validation auc = 0.677947
Epoch 1211
Validation auc = 0.678712
Epoch 1212
Loss = 2.0155e-04, PNorm = 102.0126, GNorm = 0.0062, lr_0 = 9.3970e-04
Validation auc = 0.679915
Epoch 1213
Validation auc = 0.680899
Epoch 1214
Validation auc = 0.681336
Epoch 1215
Validation auc = 0.682156
Epoch 1216
Loss = 8.0684e-05, PNorm = 102.0160, GNorm = 0.0010, lr_0 = 9.3946e-04
Validation auc = 0.682484
Epoch 1217
Validation auc = 0.682976
Epoch 1218
Validation auc = 0.682976
Epoch 1219
Validation auc = 0.682703
Epoch 1220
Validation auc = 0.682757
Epoch 1221
Loss = 5.9854e-05, PNorm = 102.0199, GNorm = 0.0020, lr_0 = 9.3923e-04
Loss = 1.1679e-04, PNorm = 102.0202, GNorm = 0.0075, lr_0 = 9.3922e-04
Validation auc = 0.682648
Epoch 1222
Validation auc = 0.682812
Epoch 1223
Validation auc = 0.682921
Epoch 1224
Validation auc = 0.683140
Epoch 1225
Validation auc = 0.683250
Epoch 1226
Loss = 1.0751e-04, PNorm = 102.0246, GNorm = 0.0039, lr_0 = 9.3900e-04
Validation auc = 0.683359
Epoch 1227
Validation auc = 0.683687
Epoch 1228
Validation auc = 0.683796
Epoch 1229
Validation auc = 0.683742
Epoch 1230
Validation auc = 0.683906
Epoch 1231
Loss = 2.7497e-05, PNorm = 102.0300, GNorm = 0.0011, lr_0 = 9.3875e-04
Validation auc = 0.683851
Epoch 1232
Validation auc = 0.683906
Epoch 1233
Validation auc = 0.683632
Epoch 1234
Validation auc = 0.683468
Epoch 1235
Loss = 6.4532e-05, PNorm = 102.0343, GNorm = 0.0007, lr_0 = 9.3853e-04
Loss = 4.3710e-07, PNorm = 102.0346, GNorm = 0.0000, lr_0 = 9.3852e-04
Validation auc = 0.683414
Epoch 1236
Validation auc = 0.713536
Epoch 1237
Validation auc = 0.718620
Epoch 1238
Validation auc = 0.712333
Epoch 1239
Validation auc = 0.708233
Epoch 1240
Loss = 2.7766e-04, PNorm = 102.1401, GNorm = 0.0061, lr_0 = 9.3828e-04
Loss = 3.4012e-05, PNorm = 102.1495, GNorm = 0.0011, lr_0 = 9.3827e-04
Validation auc = 0.708889
Epoch 1241
Validation auc = 0.710256
Epoch 1242
Validation auc = 0.711732
Epoch 1243
Validation auc = 0.713317
Epoch 1244
Validation auc = 0.718511
Epoch 1245
Loss = 1.4866e-03, PNorm = 102.2328, GNorm = 0.0839, lr_0 = 9.3805e-04
Validation auc = 0.722338
Epoch 1246
Validation auc = 0.729007
Epoch 1247
Validation auc = 0.735294
Epoch 1248
Validation auc = 0.745189
Epoch 1249
Loss = 1.8699e-04, PNorm = 102.2955, GNorm = 0.0054, lr_0 = 9.3782e-04
Validation auc = 0.750437
Epoch 1250
Validation auc = 0.753663
Epoch 1251
Validation auc = 0.762464
Epoch 1252
Validation auc = 0.767494
Epoch 1253
Validation auc = 0.758638
Epoch 1254
Loss = 1.6942e-03, PNorm = 102.3623, GNorm = 0.0442, lr_0 = 9.3758e-04
Loss = 6.3446e-04, PNorm = 102.3683, GNorm = 0.0250, lr_0 = 9.3757e-04
Validation auc = 0.748251
Epoch 1255
Validation auc = 0.741362
Epoch 1256
Validation auc = 0.738246
Epoch 1257
Validation auc = 0.740706
Epoch 1258
Validation auc = 0.741308
Epoch 1259
Loss = 6.0346e-04, PNorm = 102.4372, GNorm = 0.0191, lr_0 = 9.3735e-04
Validation auc = 0.741909
Epoch 1260
Validation auc = 0.741144
Epoch 1261
Validation auc = 0.738684
Epoch 1262
Validation auc = 0.736442
Epoch 1263
Validation auc = 0.735294
Epoch 1264
Loss = 1.2124e-02, PNorm = 102.4846, GNorm = 1.4312, lr_0 = 9.3710e-04
Validation auc = 0.728843
Epoch 1265
Validation auc = 0.724142
Epoch 1266
Validation auc = 0.736661
Epoch 1267
Validation auc = 0.735950
Epoch 1268
Loss = 9.0771e-04, PNorm = 102.5361, GNorm = 0.0038, lr_0 = 9.3689e-04
Loss = 1.5973e-04, PNorm = 102.5438, GNorm = 0.0062, lr_0 = 9.3687e-04
Validation auc = 0.733435
Epoch 1269
Validation auc = 0.728953
Epoch 1270
Validation auc = 0.728953
Epoch 1271
Validation auc = 0.708506
Epoch 1272
Validation auc = 0.686694
Epoch 1273
Loss = 5.1994e-03, PNorm = 102.6793, GNorm = 0.0594, lr_0 = 9.3664e-04
Loss = 5.8633e-04, PNorm = 102.6899, GNorm = 0.0266, lr_0 = 9.3662e-04
Validation auc = 0.674065
Epoch 1274
Validation auc = 0.663514
Epoch 1275
Validation auc = 0.661054
Epoch 1276
Validation auc = 0.678165
Epoch 1277
Validation auc = 0.709436
Epoch 1278
Loss = 1.1263e-02, PNorm = 102.9347, GNorm = 0.6654, lr_0 = 9.3641e-04
Validation auc = 0.724087
Epoch 1279
Validation auc = 0.700197
Epoch 1280
Validation auc = 0.699267
Epoch 1281
Validation auc = 0.698338
Epoch 1282
Validation auc = 0.693910
Epoch 1283
Loss = 8.1703e-02, PNorm = 103.5230, GNorm = 1.0856, lr_0 = 9.3616e-04
Validation auc = 0.702821
Epoch 1284
Validation auc = 0.708725
Epoch 1285
Validation auc = 0.712935
Epoch 1286
Validation auc = 0.718511
Epoch 1287
Loss = 2.1716e-03, PNorm = 103.9430, GNorm = 0.0588, lr_0 = 9.3594e-04
Loss = 8.3230e-03, PNorm = 103.9644, GNorm = 0.4075, lr_0 = 9.3592e-04
Validation auc = 0.723103
Epoch 1288
Validation auc = 0.720042
Epoch 1289
Validation auc = 0.712169
Epoch 1290
Validation auc = 0.717308
Epoch 1291
Validation auc = 0.718347
Epoch 1292
Loss = 4.8947e-02, PNorm = 104.1110, GNorm = 0.9847, lr_0 = 9.3571e-04
Validation auc = 0.715012
Epoch 1293
Validation auc = 0.713153
Epoch 1294
Validation auc = 0.704953
Epoch 1295
Validation auc = 0.702766
Epoch 1296
Validation auc = 0.702220
Epoch 1297
Loss = 9.3397e-02, PNorm = 104.2668, GNorm = 1.2114, lr_0 = 9.3546e-04
Validation auc = 0.701126
Epoch 1298
Validation auc = 0.700853
Epoch 1299
Validation auc = 0.699377
Epoch 1300
Validation auc = 0.700251
Epoch 1301
Loss = 8.7510e-03, PNorm = 104.4155, GNorm = 0.1295, lr_0 = 9.3524e-04
Loss = 2.2877e-03, PNorm = 104.4256, GNorm = 0.0629, lr_0 = 9.3523e-04
Validation auc = 0.699759
Epoch 1302
Validation auc = 0.700579
Epoch 1303
Validation auc = 0.702384
Epoch 1304
Validation auc = 0.702876
Epoch 1305
Validation auc = 0.703149
Epoch 1306
Loss = 4.8908e-02, PNorm = 104.5222, GNorm = 0.0121, lr_0 = 9.3499e-04
Loss = 2.2965e-04, PNorm = 104.5268, GNorm = 0.0095, lr_0 = 9.3498e-04
Validation auc = 0.699869
Epoch 1307
Validation auc = 0.708069
Epoch 1308
Validation auc = 0.691176
Epoch 1309
Validation auc = 0.687787
Epoch 1310
Validation auc = 0.689591
Epoch 1311
Loss = 3.1203e-02, PNorm = 104.7432, GNorm = 0.7546, lr_0 = 9.3476e-04
Validation auc = 0.689044
Epoch 1312
Validation auc = 0.675760
Epoch 1313
Validation auc = 0.643943
Epoch 1314
Validation auc = 0.620927
Epoch 1315
Validation auc = 0.618904
Epoch 1316
Loss = 6.4730e-02, PNorm = 105.0864, GNorm = 1.2956, lr_0 = 9.3451e-04
Validation auc = 0.653564
Epoch 1317
Validation auc = 0.681336
Epoch 1318
Validation auc = 0.692598
Epoch 1319
Validation auc = 0.692762
Epoch 1320
Loss = 5.5976e-02, PNorm = 105.3315, GNorm = 0.9414, lr_0 = 9.3430e-04
Loss = 6.5932e-03, PNorm = 105.3524, GNorm = 0.1415, lr_0 = 9.3428e-04
Validation auc = 0.693527
Epoch 1321
Validation auc = 0.689099
Epoch 1322
Validation auc = 0.692653
Epoch 1323
Validation auc = 0.693090
Epoch 1324
Validation auc = 0.705062
Epoch 1325
Loss = 6.4540e-03, PNorm = 105.5639, GNorm = 0.1904, lr_0 = 9.3407e-04
Validation auc = 0.713317
Epoch 1326
Validation auc = 0.714629
Epoch 1327
Validation auc = 0.703477
Epoch 1328
Validation auc = 0.698283
Epoch 1329
Validation auc = 0.694730
Epoch 1330
Loss = 3.9793e-03, PNorm = 105.7282, GNorm = 0.0845, lr_0 = 9.3382e-04
Validation auc = 0.692325
Epoch 1331
Validation auc = 0.689318
Epoch 1332
Validation auc = 0.703368
Epoch 1333
Validation auc = 0.707304
Epoch 1334
Loss = 8.4119e-02, PNorm = 105.9200, GNorm = 0.5357, lr_0 = 9.3360e-04
Loss = 3.5902e-02, PNorm = 105.9361, GNorm = 1.0420, lr_0 = 9.3359e-04
Validation auc = 0.705664
Epoch 1335
Validation auc = 0.701673
Epoch 1336
Validation auc = 0.688716
Epoch 1337
Validation auc = 0.674229
Epoch 1338
Validation auc = 0.660945
Epoch 1339
Loss = 8.0269e-02, PNorm = 106.1907, GNorm = 0.4753, lr_0 = 9.3336e-04
Loss = 1.7762e-01, PNorm = 106.2122, GNorm = 3.1752, lr_0 = 9.3334e-04
Validation auc = 0.662585
Epoch 1340
Validation auc = 0.670129
Epoch 1341
Validation auc = 0.679149
Epoch 1342
Validation auc = 0.695167
Epoch 1343
Validation auc = 0.699377
Epoch 1344
Loss = 1.4199e-02, PNorm = 106.5297, GNorm = 0.3006, lr_0 = 9.3312e-04
Validation auc = 0.692379
Epoch 1345
Validation auc = 0.683468
Epoch 1346
Validation auc = 0.667724
Epoch 1347
Validation auc = 0.661601
Epoch 1348
Validation auc = 0.658157
Epoch 1349
Loss = 9.3118e-02, PNorm = 106.7999, GNorm = 1.9293, lr_0 = 9.3288e-04
Validation auc = 0.665865
Epoch 1350
Validation auc = 0.667778
Epoch 1351
Validation auc = 0.658758
Epoch 1352
Validation auc = 0.652580
Epoch 1353
Loss = 6.0063e-02, PNorm = 107.1779, GNorm = 0.8990, lr_0 = 9.3266e-04
Loss = 1.7974e-03, PNorm = 107.2043, GNorm = 0.0367, lr_0 = 9.3264e-04
Validation auc = 0.655642
Epoch 1354
Validation auc = 0.645473
Epoch 1355
Validation auc = 0.624754
Epoch 1356
Validation auc = 0.633228
Epoch 1357
Validation auc = 0.625957
Epoch 1358
Loss = 4.1365e-02, PNorm = 107.5245, GNorm = 0.1705, lr_0 = 9.3241e-04
Validation auc = 0.615460
Epoch 1359
Validation auc = 0.610376
Epoch 1360
Validation auc = 0.593757
Epoch 1361
Validation auc = 0.574568
Epoch 1362
Validation auc = 0.554067
Epoch 1363
Loss = 1.7936e-02, PNorm = 107.8583, GNorm = 0.3604, lr_0 = 9.3218e-04
Validation auc = 0.541658
Epoch 1364
Validation auc = 0.537940
Epoch 1365
Validation auc = 0.536191
Epoch 1366
Validation auc = 0.535863
Epoch 1367
Loss = 5.0344e-03, PNorm = 108.0667, GNorm = 0.2548, lr_0 = 9.3197e-04
Loss = 1.0470e-02, PNorm = 108.0800, GNorm = 2.0351, lr_0 = 9.3195e-04
Validation auc = 0.537667
Epoch 1368
Validation auc = 0.537448
Epoch 1369
Validation auc = 0.544719
Epoch 1370
Validation auc = 0.559152
Epoch 1371
Validation auc = 0.581730
Epoch 1372
Loss = 8.6364e-03, PNorm = 108.2101, GNorm = 0.6512, lr_0 = 9.3172e-04
Loss = 2.4034e-03, PNorm = 108.2212, GNorm = 0.0441, lr_0 = 9.3170e-04
Validation auc = 0.603543
Epoch 1373
Validation auc = 0.621255
Epoch 1374
Validation auc = 0.633228
Epoch 1375
Validation auc = 0.640225
Epoch 1376
Validation auc = 0.645692
Epoch 1377
Loss = 3.6567e-03, PNorm = 108.3135, GNorm = 0.1329, lr_0 = 9.3149e-04
Validation auc = 0.649191
Epoch 1378
Validation auc = 0.651159
Epoch 1379
Validation auc = 0.653619
Epoch 1380
Validation auc = 0.649136
Epoch 1381
Validation auc = 0.639897
Epoch 1382
Loss = 3.3876e-02, PNorm = 108.3893, GNorm = 0.5660, lr_0 = 9.3124e-04
Validation auc = 0.635305
Epoch 1383
Validation auc = 0.637328
Epoch 1384
Validation auc = 0.641373
Epoch 1385
Validation auc = 0.648863
Epoch 1386
Loss = 6.4217e-03, PNorm = 108.4659, GNorm = 0.4664, lr_0 = 9.3102e-04
Loss = 2.6220e-03, PNorm = 108.4730, GNorm = 0.0614, lr_0 = 9.3101e-04
Validation auc = 0.655642
Epoch 1387
Validation auc = 0.660617
Epoch 1388
Validation auc = 0.661437
Epoch 1389
Validation auc = 0.663569
Epoch 1390
Validation auc = 0.664717
Epoch 1391
Loss = 3.0403e-03, PNorm = 108.5214, GNorm = 0.0689, lr_0 = 9.3078e-04
Validation auc = 0.666740
Epoch 1392
Validation auc = 0.667560
Epoch 1393
Validation auc = 0.668489
Epoch 1394
Validation auc = 0.671386
Epoch 1395
Validation auc = 0.671386
Epoch 1396
Loss = 1.0749e-01, PNorm = 108.5701, GNorm = 0.7459, lr_0 = 9.3055e-04
Validation auc = 0.669582
Epoch 1397
Validation auc = 0.667286
Epoch 1398
Validation auc = 0.665209
Epoch 1399
Validation auc = 0.665920
Epoch 1400
Loss = 1.7947e-03, PNorm = 108.6013, GNorm = 0.0527, lr_0 = 9.3033e-04
Loss = 1.9246e-03, PNorm = 108.6052, GNorm = 0.0707, lr_0 = 9.3032e-04
Validation auc = 0.665810
Epoch 1401
Validation auc = 0.666630
Epoch 1402
Validation auc = 0.666576
Epoch 1403
Validation auc = 0.666193
Epoch 1404
Validation auc = 0.665592
Epoch 1405
Loss = 2.5662e-03, PNorm = 108.6492, GNorm = 0.2538, lr_0 = 9.3008e-04
Loss = 6.7865e-05, PNorm = 108.6518, GNorm = 0.0025, lr_0 = 9.3007e-04
Validation auc = 0.665537
Epoch 1406
Validation auc = 0.665373
Epoch 1407
Validation auc = 0.665099
Epoch 1408
Validation auc = 0.665045
Epoch 1409
Validation auc = 0.665154
Epoch 1410
Loss = 9.5737e-04, PNorm = 108.6805, GNorm = 0.0194, lr_0 = 9.2985e-04
Validation auc = 0.664935
Epoch 1411
Validation auc = 0.665209
Epoch 1412
Validation auc = 0.665154
Epoch 1413
Validation auc = 0.665482
Epoch 1414
Validation auc = 0.665920
Epoch 1415
Loss = 3.3309e-04, PNorm = 108.7028, GNorm = 0.0070, lr_0 = 9.2961e-04
Validation auc = 0.665810
Epoch 1416
Validation auc = 0.665646
Epoch 1417
Validation auc = 0.665209
Epoch 1418
Validation auc = 0.665264
Epoch 1419
Loss = 2.8197e-03, PNorm = 108.7196, GNorm = 0.0065, lr_0 = 9.2939e-04
Loss = 1.2477e-04, PNorm = 108.7210, GNorm = 0.0040, lr_0 = 9.2938e-04
Validation auc = 0.665482
Epoch 1420
Validation auc = 0.665373
Epoch 1421
Validation auc = 0.663623
Epoch 1422
Validation auc = 0.661655
Epoch 1423
Validation auc = 0.660343
Epoch 1424
Loss = 6.4146e-03, PNorm = 108.7528, GNorm = 0.5284, lr_0 = 9.2914e-04
Validation auc = 0.660453
Epoch 1425
Validation auc = 0.659961
Epoch 1426
Validation auc = 0.659250
Epoch 1427
Validation auc = 0.658102
Epoch 1428
Validation auc = 0.656845
Epoch 1429
Loss = 1.0973e-03, PNorm = 108.7919, GNorm = 0.0550, lr_0 = 9.2891e-04
Validation auc = 0.656188
Epoch 1430
Validation auc = 0.655915
Epoch 1431
Validation auc = 0.656243
Epoch 1432
Validation auc = 0.656735
Epoch 1433
Loss = 1.8130e-04, PNorm = 108.8187, GNorm = 0.0015, lr_0 = 9.2868e-04
Validation auc = 0.656790
Epoch 1434
Validation auc = 0.656899
Epoch 1435
Validation auc = 0.656899
Epoch 1436
Validation auc = 0.656735
Epoch 1437
Validation auc = 0.656790
Epoch 1438
Loss = 1.0513e-04, PNorm = 108.8335, GNorm = 0.0048, lr_0 = 9.2845e-04
Loss = 1.3312e-06, PNorm = 108.8342, GNorm = 0.0001, lr_0 = 9.2844e-04
Validation auc = 0.656790
Epoch 1439
Validation auc = 0.656735
Epoch 1440
Validation auc = 0.659359
Epoch 1441
Validation auc = 0.661765
Epoch 1442
Validation auc = 0.665099
Epoch 1443
Loss = 1.2812e-04, PNorm = 108.8505, GNorm = 0.0043, lr_0 = 9.2822e-04
Validation auc = 0.666794
Epoch 1444
Validation auc = 0.666630
Epoch 1445
Validation auc = 0.669200
Epoch 1446
Validation auc = 0.671988
Epoch 1447
Validation auc = 0.673901
Epoch 1448
Loss = 1.4642e-05, PNorm = 108.9251, GNorm = 0.0005, lr_0 = 9.2798e-04
Validation auc = 0.676252
Epoch 1449
Validation auc = 0.676525
Epoch 1450
Validation auc = 0.676471
Epoch 1451
Validation auc = 0.677619
Epoch 1452
Loss = 4.4649e-03, PNorm = 108.9664, GNorm = 0.5816, lr_0 = 9.2776e-04
Loss = 5.4158e-03, PNorm = 108.9714, GNorm = 0.6994, lr_0 = 9.2775e-04
Validation auc = 0.679095
Epoch 1453
Validation auc = 0.684124
Epoch 1454
Validation auc = 0.685874
Epoch 1455
Validation auc = 0.688170
Epoch 1456
Validation auc = 0.689044
Epoch 1457
Loss = 2.4140e-03, PNorm = 109.0230, GNorm = 0.8311, lr_0 = 9.2752e-04
Loss = 3.9736e-08, PNorm = 109.0252, GNorm = 0.0000, lr_0 = 9.2750e-04
Validation auc = 0.688771
Epoch 1458
Validation auc = 0.687076
Epoch 1459
Validation auc = 0.686803
Epoch 1460
Validation auc = 0.688716
Epoch 1461
Validation auc = 0.686147
Epoch 1462
Loss = 4.7995e-04, PNorm = 109.1056, GNorm = 0.0790, lr_0 = 9.2729e-04
Validation auc = 0.678384
Epoch 1463
Validation auc = 0.696151
Epoch 1464
Validation auc = 0.713372
Epoch 1465
Validation auc = 0.724251
Epoch 1466
Loss = 1.0612e-01, PNorm = 109.3013, GNorm = 0.0164, lr_0 = 9.2706e-04
Validation auc = 0.729718
Epoch 1467
Validation auc = 0.739613
Epoch 1468
Validation auc = 0.753444
Epoch 1469
Validation auc = 0.759184
Epoch 1470
Validation auc = 0.752952
Epoch 1471
Loss = 1.9296e-01, PNorm = 109.7085, GNorm = 1.3112, lr_0 = 9.2683e-04
Loss = 4.8642e-02, PNorm = 109.7399, GNorm = 0.6617, lr_0 = 9.2681e-04
Validation auc = 0.731577
Epoch 1472
Validation auc = 0.722392
Epoch 1473
Validation auc = 0.718019
Epoch 1474
Validation auc = 0.708014
Epoch 1475
Validation auc = 0.682539
Epoch 1476
Loss = 2.6770e-03, PNorm = 110.0978, GNorm = 0.0463, lr_0 = 9.2660e-04
Validation auc = 0.667341
Epoch 1477
Validation auc = 0.659851
Epoch 1478
Validation auc = 0.660234
Epoch 1479
Validation auc = 0.670020
Epoch 1480
Validation auc = 0.678876
Epoch 1481
Loss = 1.6072e-02, PNorm = 110.3088, GNorm = 0.7993, lr_0 = 9.2635e-04
Validation auc = 0.697901
Epoch 1482
Validation auc = 0.714028
Epoch 1483
Validation auc = 0.712716
Epoch 1484
Validation auc = 0.701728
Epoch 1485
Loss = 3.1116e-02, PNorm = 110.4261, GNorm = 5.4040, lr_0 = 9.2614e-04
Loss = 2.0663e-06, PNorm = 110.4361, GNorm = 0.0001, lr_0 = 9.2612e-04
Validation auc = 0.717581
Epoch 1486
Validation auc = 0.727203
Epoch 1487
Validation auc = 0.728679
Epoch 1488
Validation auc = 0.729827
Epoch 1489
Validation auc = 0.718401
Epoch 1490
Loss = 1.7040e-02, PNorm = 110.5654, GNorm = 3.4505, lr_0 = 9.2589e-04
Loss = 1.8389e-03, PNorm = 110.5743, GNorm = 0.0770, lr_0 = 9.2587e-04
Validation auc = 0.709490
Epoch 1491
Validation auc = 0.701564
Epoch 1492
Validation auc = 0.690302
Epoch 1493
Validation auc = 0.680133
Epoch 1494
Validation auc = 0.677837
Epoch 1495
Loss = 4.6362e-03, PNorm = 110.6432, GNorm = 0.0944, lr_0 = 9.2566e-04
Validation auc = 0.674284
Epoch 1496
Validation auc = 0.672152
Epoch 1497
Validation auc = 0.671222
Epoch 1498
Validation auc = 0.668325
Epoch 1499
Loss = 6.9622e-03, PNorm = 110.7153, GNorm = 0.1334, lr_0 = 9.2543e-04
Validation auc = 0.666576
Epoch 1500
Validation auc = 0.661054
Epoch 1501
Validation auc = 0.658758
Epoch 1502
Validation auc = 0.657665
Epoch 1503
Validation auc = 0.658813
Epoch 1504
Loss = 7.4236e-04, PNorm = 110.7764, GNorm = 0.0084, lr_0 = 9.2520e-04
Loss = 5.4730e-04, PNorm = 110.7807, GNorm = 0.0155, lr_0 = 9.2518e-04
Validation auc = 0.665154
Epoch 1505
Validation auc = 0.674284
Epoch 1506
Validation auc = 0.684726
Epoch 1507
Validation auc = 0.691122
Epoch 1508
Validation auc = 0.694949
Epoch 1509
Loss = 6.3707e-04, PNorm = 110.8265, GNorm = 0.0227, lr_0 = 9.2497e-04
Validation auc = 0.697901
Epoch 1510
Validation auc = 0.701181
Epoch 1511
Validation auc = 0.697846
Epoch 1512
Validation auc = 0.703422
Epoch 1513
Validation auc = 0.689044
Epoch 1514
Loss = 1.6296e-03, PNorm = 110.8943, GNorm = 0.0804, lr_0 = 9.2472e-04
Validation auc = 0.677947
Epoch 1515
Validation auc = 0.668598
Epoch 1516
Validation auc = 0.665592
Epoch 1517
Validation auc = 0.660289
Epoch 1518
Loss = 3.2595e-02, PNorm = 111.0293, GNorm = 3.4138, lr_0 = 9.2451e-04
Loss = 7.0645e-04, PNorm = 111.0401, GNorm = 0.0410, lr_0 = 9.2449e-04
Validation auc = 0.713809
Epoch 1519
Validation auc = 0.743604
Epoch 1520
Validation auc = 0.745955
Epoch 1521
Validation auc = 0.749344
Epoch 1522
Validation auc = 0.746228
Epoch 1523
Loss = 4.9248e-03, PNorm = 111.1946, GNorm = 0.0436, lr_0 = 9.2427e-04
Loss = 3.9463e-03, PNorm = 111.2053, GNorm = 0.1231, lr_0 = 9.2425e-04
Validation auc = 0.744424
Epoch 1524
Validation auc = 0.743330
Epoch 1525
Validation auc = 0.744041
Epoch 1526
Validation auc = 0.745025
Epoch 1527
Validation auc = 0.745080
Epoch 1528
Loss = 3.4380e-03, PNorm = 111.3111, GNorm = 0.4609, lr_0 = 9.2404e-04
Validation auc = 0.745462
Epoch 1529
Validation auc = 0.746556
Epoch 1530
Validation auc = 0.748305
Epoch 1531
Validation auc = 0.745298
Epoch 1532
Validation auc = 0.741253
Epoch 1533
Loss = 6.5107e-04, PNorm = 111.3668, GNorm = 0.0166, lr_0 = 9.2379e-04
Validation auc = 0.736223
Epoch 1534
Validation auc = 0.727476
Epoch 1535
Validation auc = 0.730538
Epoch 1536
Validation auc = 0.731631
Epoch 1537
Loss = 4.7908e-03, PNorm = 111.4013, GNorm = 0.3146, lr_0 = 9.2358e-04
Loss = 8.6757e-04, PNorm = 111.4054, GNorm = 0.0249, lr_0 = 9.2356e-04
Validation auc = 0.733763
Epoch 1538
Validation auc = 0.733271
Epoch 1539
Validation auc = 0.732834
Epoch 1540
Validation auc = 0.732725
Epoch 1541
Validation auc = 0.732233
Epoch 1542
Loss = 4.8600e-02, PNorm = 111.4282, GNorm = 0.5254, lr_0 = 9.2335e-04
Validation auc = 0.735567
Epoch 1543
Validation auc = 0.739504
Epoch 1544
Validation auc = 0.742292
Epoch 1545
Validation auc = 0.747212
Epoch 1546
Validation auc = 0.751859
Epoch 1547
Loss = 4.0863e-02, PNorm = 111.5539, GNorm = 0.7085, lr_0 = 9.2310e-04
Validation auc = 0.754866
Epoch 1548
Validation auc = 0.756998
Epoch 1549
Validation auc = 0.760551
Epoch 1550
Validation auc = 0.768478
Epoch 1551
Loss = 6.6603e-03, PNorm = 111.6526, GNorm = 0.4946, lr_0 = 9.2289e-04
Loss = 1.8062e-03, PNorm = 111.6592, GNorm = 0.0361, lr_0 = 9.2287e-04
Validation auc = 0.770610
Epoch 1552
Validation auc = 0.761863
Epoch 1553
Validation auc = 0.749180
Epoch 1554
Validation auc = 0.735075
Epoch 1555
Validation auc = 0.726820
Epoch 1556
Loss = 4.5511e-03, PNorm = 111.7337, GNorm = 0.1249, lr_0 = 9.2264e-04
Loss = 5.4467e-04, PNorm = 111.7384, GNorm = 0.0174, lr_0 = 9.2263e-04
Validation auc = 0.720151
Epoch 1557
Validation auc = 0.715887
Epoch 1558
Validation auc = 0.715395
Epoch 1559
Validation auc = 0.715012
Epoch 1560
Validation auc = 0.722447
Epoch 1561
Loss = 1.1111e-03, PNorm = 111.7940, GNorm = 0.0192, lr_0 = 9.2242e-04
Validation auc = 0.727914
Epoch 1562
Validation auc = 0.731795
Epoch 1563
Validation auc = 0.733107
Epoch 1564
Validation auc = 0.734365
Epoch 1565
Validation auc = 0.733873
Epoch 1566
Loss = 5.7431e-03, PNorm = 111.8646, GNorm = 0.3544, lr_0 = 9.2217e-04
Validation auc = 0.733053
Epoch 1567
Validation auc = 0.733982
Epoch 1568
Validation auc = 0.735130
Epoch 1569
Validation auc = 0.735622
Epoch 1570
Loss = 9.5780e-03, PNorm = 111.9214, GNorm = 0.0058, lr_0 = 9.2196e-04
Loss = 2.2848e-06, PNorm = 111.9247, GNorm = 0.0001, lr_0 = 9.2194e-04
Validation auc = 0.737262
Epoch 1571
Validation auc = 0.736387
Epoch 1572
Validation auc = 0.736934
Epoch 1573
Validation auc = 0.733763
Epoch 1574
Validation auc = 0.734091
Epoch 1575
Loss = 1.4152e-03, PNorm = 111.9716, GNorm = 0.0821, lr_0 = 9.2173e-04
Validation auc = 0.728023
Epoch 1576
Validation auc = 0.716269
Epoch 1577
Validation auc = 0.705390
Epoch 1578
Validation auc = 0.700470
Epoch 1579
Validation auc = 0.700579
Epoch 1580
Loss = 1.4735e-01, PNorm = 112.1370, GNorm = 2.0925, lr_0 = 9.2148e-04
Validation auc = 0.692543
Epoch 1581
Validation auc = 0.677837
Epoch 1582
Validation auc = 0.666630
Epoch 1583
Validation auc = 0.661765
Epoch 1584
Loss = 4.7437e-03, PNorm = 112.2512, GNorm = 0.0819, lr_0 = 9.2127e-04
Loss = 2.7588e-03, PNorm = 112.2601, GNorm = 0.0620, lr_0 = 9.2125e-04
Validation auc = 0.658047
Epoch 1585
Validation auc = 0.656134
Epoch 1586
Validation auc = 0.656517
Epoch 1587
Validation auc = 0.659031
Epoch 1588
Validation auc = 0.661327
Epoch 1589
Loss = 1.5495e-03, PNorm = 112.3383, GNorm = 0.0770, lr_0 = 9.2103e-04
Loss = 1.0779e-04, PNorm = 112.3421, GNorm = 0.0036, lr_0 = 9.2101e-04
Validation auc = 0.662803
Epoch 1590
Validation auc = 0.665209
Epoch 1591
Validation auc = 0.669528
Epoch 1592
Validation auc = 0.672480
Epoch 1593
Validation auc = 0.676252
Epoch 1594
Loss = 4.8860e-04, PNorm = 112.3789, GNorm = 0.0130, lr_0 = 9.2080e-04
Validation auc = 0.675705
Epoch 1595
Validation auc = 0.670184
Epoch 1596
Validation auc = 0.663569
Epoch 1597
Validation auc = 0.659578
Epoch 1598
Validation auc = 0.657173
Epoch 1599
Loss = 6.2319e-02, PNorm = 112.4054, GNorm = 2.6271, lr_0 = 9.2055e-04
Validation auc = 0.666849
Epoch 1600
Validation auc = 0.682375
Epoch 1601
Validation auc = 0.696589
Epoch 1602
Validation auc = 0.707686
Epoch 1603
Loss = 3.3442e-04, PNorm = 112.4554, GNorm = 0.0032, lr_0 = 9.2034e-04
Loss = 2.8795e-04, PNorm = 112.4585, GNorm = 0.0097, lr_0 = 9.2032e-04
Validation auc = 0.715012
Epoch 1604
Validation auc = 0.721080
Epoch 1605
Validation auc = 0.718565
Epoch 1606
Validation auc = 0.718839
Epoch 1607
Validation auc = 0.719440
Epoch 1608
Loss = 1.4122e-02, PNorm = 112.5058, GNorm = 0.0188, lr_0 = 9.2010e-04
Validation auc = 0.720151
Epoch 1609
Validation auc = 0.719167
Epoch 1610
Validation auc = 0.717253
Epoch 1611
Validation auc = 0.716324
Epoch 1612
Validation auc = 0.715887
Epoch 1613
Loss = 3.7428e-02, PNorm = 112.5609, GNorm = 0.7089, lr_0 = 9.1987e-04
Validation auc = 0.713755
Epoch 1614
Validation auc = 0.713536
Epoch 1615
Validation auc = 0.712552
Epoch 1616
Validation auc = 0.711295
Epoch 1617
Loss = 4.3984e-04, PNorm = 112.5900, GNorm = 0.0068, lr_0 = 9.1966e-04
Loss = 4.6688e-04, PNorm = 112.5918, GNorm = 0.0186, lr_0 = 9.1964e-04
Validation auc = 0.709709
Epoch 1618
Validation auc = 0.709053
Epoch 1619
Validation auc = 0.709053
Epoch 1620
Validation auc = 0.708780
Epoch 1621
Validation auc = 0.707741
Epoch 1622
Loss = 6.5683e-03, PNorm = 112.6126, GNorm = 0.3365, lr_0 = 9.1941e-04
Loss = 4.6389e-05, PNorm = 112.6145, GNorm = 0.0021, lr_0 = 9.1939e-04
Validation auc = 0.705773
Epoch 1623
Validation auc = 0.703149
Epoch 1624
Validation auc = 0.702821
Epoch 1625
Validation auc = 0.701564
Epoch 1626
Validation auc = 0.701345
Epoch 1627
Loss = 7.9149e-05, PNorm = 112.6417, GNorm = 0.0021, lr_0 = 9.1918e-04
Validation auc = 0.700908
Epoch 1628
Validation auc = 0.699759
Epoch 1629
Validation auc = 0.698611
Epoch 1630
Validation auc = 0.697791
Epoch 1631
Validation auc = 0.696698
Epoch 1632
Loss = 9.6025e-02, PNorm = 112.6568, GNorm = 2.5008, lr_0 = 9.1894e-04
Validation auc = 0.703914
Epoch 1633
Validation auc = 0.708561
Epoch 1634
Validation auc = 0.708124
Epoch 1635
Validation auc = 0.707194
Epoch 1636
Loss = 2.9718e-03, PNorm = 112.6864, GNorm = 0.1436, lr_0 = 9.1873e-04
Loss = 6.8724e-03, PNorm = 112.6896, GNorm = 0.3635, lr_0 = 9.1871e-04
Validation auc = 0.707249
Epoch 1637
Validation auc = 0.704953
Epoch 1638
Validation auc = 0.703532
Epoch 1639
Validation auc = 0.702001
Epoch 1640
Validation auc = 0.701837
Epoch 1641
Loss = 1.3134e-03, PNorm = 112.7376, GNorm = 0.0038, lr_0 = 9.1848e-04
Validation auc = 0.701400
Epoch 1642
Validation auc = 0.700579
Epoch 1643
Validation auc = 0.700579
Epoch 1644
Validation auc = 0.699978
Epoch 1645
Validation auc = 0.699923
Epoch 1646
Loss = 1.4481e-01, PNorm = 112.7639, GNorm = 0.6846, lr_0 = 9.1825e-04
Validation auc = 0.698447
Epoch 1647
Validation auc = 0.697901
Epoch 1648
Validation auc = 0.697846
Epoch 1649
Validation auc = 0.697901
Epoch 1650
Loss = 3.3079e-04, PNorm = 112.7624, GNorm = 0.0021, lr_0 = 9.1804e-04
Loss = 2.5829e-07, PNorm = 112.7627, GNorm = 0.0000, lr_0 = 9.1803e-04
Validation auc = 0.697901
Epoch 1651
Validation auc = 0.697955
Epoch 1652
Validation auc = 0.698065
Epoch 1653
Validation auc = 0.699103
Epoch 1654
Validation auc = 0.699705
Epoch 1655
Loss = 1.8984e-03, PNorm = 112.7716, GNorm = 0.0082, lr_0 = 9.1780e-04
Loss = 3.9222e-04, PNorm = 112.7732, GNorm = 0.0168, lr_0 = 9.1778e-04
Validation auc = 0.700087
Epoch 1656
Validation auc = 0.699431
Epoch 1657
Validation auc = 0.698010
Epoch 1658
Validation auc = 0.697026
Epoch 1659
Validation auc = 0.695878
Epoch 1660
Loss = 2.5321e-04, PNorm = 112.8128, GNorm = 0.0062, lr_0 = 9.1757e-04
Validation auc = 0.695495
Epoch 1661
Validation auc = 0.695495
Epoch 1662
Validation auc = 0.695167
Epoch 1663
Validation auc = 0.694457
Epoch 1664
Validation auc = 0.694183
Epoch 1665
Loss = 2.2266e-05, PNorm = 112.8409, GNorm = 0.0007, lr_0 = 9.1733e-04
Validation auc = 0.693582
Epoch 1666
Validation auc = 0.693090
Epoch 1667
Validation auc = 0.692598
Epoch 1668
Validation auc = 0.692379
Epoch 1669
Loss = 6.9231e-05, PNorm = 112.8514, GNorm = 0.0025, lr_0 = 9.1712e-04
Loss = 1.6550e-05, PNorm = 112.8521, GNorm = 0.0007, lr_0 = 9.1710e-04
Validation auc = 0.692161
Epoch 1670
Validation auc = 0.691887
Epoch 1671
Validation auc = 0.691614
Epoch 1672
Validation auc = 0.691286
Epoch 1673
Validation auc = 0.682867
Epoch 1674
Loss = 1.6069e-04, PNorm = 112.8587, GNorm = 0.0044, lr_0 = 9.1687e-04
Validation auc = 0.671004
Epoch 1675
Validation auc = 0.661929
Epoch 1676
Validation auc = 0.673956
Epoch 1677
Validation auc = 0.692762
Epoch 1678
Validation auc = 0.697299
Epoch 1679
Loss = 1.8393e-03, PNorm = 112.9593, GNorm = 0.0314, lr_0 = 9.1664e-04
Validation auc = 0.708069
Epoch 1680
Validation auc = 0.732615
Epoch 1681
Validation auc = 0.738082
Epoch 1682
Validation auc = 0.737481
Epoch 1683
Loss = 1.4817e-02, PNorm = 113.1061, GNorm = 0.6567, lr_0 = 9.1642e-04
Validation auc = 0.744314
Epoch 1684
Validation auc = 0.744314
Epoch 1685
Validation auc = 0.743112
Epoch 1686
Validation auc = 0.741362
Epoch 1687
Validation auc = 0.738137
Epoch 1688
Loss = 2.7774e-02, PNorm = 113.2792, GNorm = 0.2102, lr_0 = 9.1619e-04
Loss = 4.2210e-03, PNorm = 113.2909, GNorm = 0.1694, lr_0 = 9.1617e-04
Validation auc = 0.734693
Epoch 1689
Validation auc = 0.732615
Epoch 1690
Validation auc = 0.729335
Epoch 1691
Validation auc = 0.726984
Epoch 1692
Validation auc = 0.725344
Epoch 1693
Loss = 2.2328e-02, PNorm = 113.4059, GNorm = 1.0607, lr_0 = 9.1596e-04
Validation auc = 0.723376
Epoch 1694
Validation auc = 0.720479
Epoch 1695
Validation auc = 0.718511
Epoch 1696
Validation auc = 0.716761
Epoch 1697
Validation auc = 0.716652
Epoch 1698
Loss = 6.0373e-04, PNorm = 113.4688, GNorm = 0.0271, lr_0 = 9.1572e-04
Validation auc = 0.715231
Epoch 1699
Validation auc = 0.714793
Epoch 1700
Validation auc = 0.711623
Epoch 1701
Validation auc = 0.709518
Epoch 1702
Loss = 6.0402e-04, PNorm = 113.4918, GNorm = 0.0295, lr_0 = 9.1551e-04
Loss = 1.1255e-04, PNorm = 113.4937, GNorm = 0.0041, lr_0 = 9.1549e-04
Validation auc = 0.709545
Epoch 1703
Validation auc = 0.708944
Epoch 1704
Validation auc = 0.708506
Epoch 1705
Validation auc = 0.708397
Epoch 1706
Validation auc = 0.707850
Epoch 1707
Loss = 2.5875e-03, PNorm = 113.5147, GNorm = 0.4224, lr_0 = 9.1526e-04
Loss = 6.0376e-05, PNorm = 113.5162, GNorm = 0.0017, lr_0 = 9.1525e-04
Validation auc = 0.707140
Epoch 1708
Validation auc = 0.704297
Epoch 1709
Validation auc = 0.701673
Epoch 1710
Validation auc = 0.697354
Epoch 1711
Validation auc = 0.693746
Epoch 1712
Loss = 1.0200e-03, PNorm = 113.5431, GNorm = 0.0585, lr_0 = 9.1504e-04
Validation auc = 0.694730
Epoch 1713
Validation auc = 0.696917
Epoch 1714
Validation auc = 0.699267
Epoch 1715
Validation auc = 0.700306
Epoch 1716
Loss = 5.7514e-04, PNorm = 113.5654, GNorm = 0.0538, lr_0 = 9.1481e-04
Validation auc = 0.701017
Epoch 1717
Validation auc = 0.700798
Epoch 1718
Validation auc = 0.700033
Epoch 1719
Validation auc = 0.699541
Epoch 1720
Validation auc = 0.699595
Epoch 1721
Loss = 6.6348e-04, PNorm = 113.5803, GNorm = 0.0089, lr_0 = 9.1458e-04
Loss = 7.2535e-04, PNorm = 113.5813, GNorm = 0.0487, lr_0 = 9.1457e-04
Validation auc = 0.699049
Epoch 1722
Validation auc = 0.698338
Epoch 1723
Validation auc = 0.697955
Epoch 1724
Validation auc = 0.697682
Epoch 1725
Validation auc = 0.697737
Epoch 1726
Loss = 3.6076e-04, PNorm = 113.5929, GNorm = 0.0077, lr_0 = 9.1436e-04
Validation auc = 0.697737
Epoch 1727
Validation auc = 0.699759
Epoch 1728
Validation auc = 0.707796
Epoch 1729
Validation auc = 0.712497
Epoch 1730
Validation auc = 0.715996
Epoch 1731
Loss = 3.7782e-04, PNorm = 113.6161, GNorm = 0.0285, lr_0 = 9.1411e-04
Validation auc = 0.719112
Epoch 1732
Validation auc = 0.720096
Epoch 1733
Validation auc = 0.722010
Epoch 1734
Validation auc = 0.722010
Epoch 1735
Loss = 2.9656e-04, PNorm = 113.6298, GNorm = 0.0094, lr_0 = 9.1390e-04
Loss = 1.1559e-04, PNorm = 113.6306, GNorm = 0.0075, lr_0 = 9.1389e-04
Validation auc = 0.722775
Epoch 1736
Validation auc = 0.722666
Epoch 1737
Validation auc = 0.722884
Epoch 1738
Validation auc = 0.722884
Epoch 1739
Validation auc = 0.722830
Epoch 1740
Loss = 2.8734e-04, PNorm = 113.6413, GNorm = 0.0167, lr_0 = 9.1366e-04
Loss = 1.6292e-06, PNorm = 113.6421, GNorm = 0.0001, lr_0 = 9.1364e-04
Validation auc = 0.723431
Epoch 1741
Validation auc = 0.723978
Epoch 1742
Validation auc = 0.724196
Epoch 1743
Validation auc = 0.724196
Epoch 1744
Validation auc = 0.724087
Epoch 1745
Loss = 1.6497e-04, PNorm = 113.6513, GNorm = 0.0052, lr_0 = 9.1343e-04
Validation auc = 0.723923
Epoch 1746
Validation auc = 0.723595
Epoch 1747
Validation auc = 0.723376
Epoch 1748
Validation auc = 0.723322
Epoch 1749
Loss = 5.1090e-05, PNorm = 113.6570, GNorm = 0.0007, lr_0 = 9.1320e-04
Validation auc = 0.723322
Epoch 1750
Validation auc = 0.723322
Epoch 1751
Validation auc = 0.723212
Epoch 1752
Validation auc = 0.723267
Epoch 1753
Validation auc = 0.723868
Epoch 1754
Loss = 2.4544e-05, PNorm = 113.6622, GNorm = 0.0021, lr_0 = 9.1298e-04
Loss = 5.8111e-05, PNorm = 113.6627, GNorm = 0.0022, lr_0 = 9.1296e-04
Validation auc = 0.723650
Epoch 1755
Validation auc = 0.723322
Epoch 1756
Validation auc = 0.722119
Epoch 1757
Validation auc = 0.720096
Epoch 1758
Validation auc = 0.717472
Epoch 1759
Loss = 5.3285e-06, PNorm = 113.6750, GNorm = 0.0002, lr_0 = 9.1275e-04
Validation auc = 0.710147
Epoch 1760
Validation auc = 0.703969
Epoch 1761
Validation auc = 0.699049
Epoch 1762
Validation auc = 0.694457
Epoch 1763
Validation auc = 0.680297
Epoch 1764
Loss = 6.3120e-04, PNorm = 113.7583, GNorm = 0.0393, lr_0 = 9.1251e-04
Validation auc = 0.640116
Epoch 1765
Validation auc = 0.575497
Epoch 1766
Validation auc = 0.612180
Epoch 1767
Validation auc = 0.662585
Epoch 1768
Loss = 6.9044e-02, PNorm = 114.1970, GNorm = 0.9805, lr_0 = 9.1230e-04
Loss = 4.7020e-04, PNorm = 114.2431, GNorm = 0.0156, lr_0 = 9.1228e-04
Validation auc = 0.682375
Epoch 1769
Validation auc = 0.692270
Epoch 1770
Validation auc = 0.687022
Epoch 1771
Validation auc = 0.674448
Epoch 1772
Validation auc = 0.662749
Epoch 1773
Loss = 2.9411e-02, PNorm = 114.7297, GNorm = 0.3703, lr_0 = 9.1206e-04
Loss = 4.9370e-02, PNorm = 114.7562, GNorm = 2.1018, lr_0 = 9.1204e-04
Validation auc = 0.646403
Epoch 1774
Validation auc = 0.629893
Epoch 1775
Validation auc = 0.626777
Epoch 1776
Validation auc = 0.627433
Epoch 1777
Validation auc = 0.627925
Epoch 1778
Loss = 1.2819e-03, PNorm = 115.0012, GNorm = 0.0245, lr_0 = 9.1183e-04
Validation auc = 0.627159
Epoch 1779
Validation auc = 0.625137
Epoch 1780
Validation auc = 0.624754
Epoch 1781
Validation auc = 0.624754
Epoch 1782
Validation auc = 0.632517
Epoch 1783
Loss = 8.3135e-04, PNorm = 115.1259, GNorm = 0.0242, lr_0 = 9.1159e-04
Validation auc = 0.637929
Epoch 1784
Validation auc = 0.642029
Epoch 1785
Validation auc = 0.642631
Epoch 1786
Validation auc = 0.643888
Epoch 1787
Loss = 4.2076e-02, PNorm = 115.2003, GNorm = 1.0826, lr_0 = 9.1138e-04
Loss = 1.1410e-03, PNorm = 115.2055, GNorm = 0.0373, lr_0 = 9.1136e-04
Validation auc = 0.650558
Epoch 1788
Validation auc = 0.657118
Epoch 1789
Validation auc = 0.660999
Epoch 1790
Validation auc = 0.664225
Epoch 1791
Validation auc = 0.665756
Epoch 1792
Loss = 6.1376e-02, PNorm = 115.2710, GNorm = 1.1531, lr_0 = 9.1115e-04
Validation auc = 0.665592
Epoch 1793
Validation auc = 0.661163
Epoch 1794
Validation auc = 0.662421
Epoch 1795
Validation auc = 0.662913
Epoch 1796
Validation auc = 0.661546
Epoch 1797
Loss = 8.2752e-03, PNorm = 115.3476, GNorm = 0.4790, lr_0 = 9.1091e-04
Validation auc = 0.660507
Epoch 1798
Validation auc = 0.659633
Epoch 1799
Validation auc = 0.657501
Epoch 1800
Validation auc = 0.655642
Epoch 1801
Loss = 3.5655e-02, PNorm = 115.4009, GNorm = 0.5798, lr_0 = 9.1070e-04
Loss = 9.6266e-04, PNorm = 115.4040, GNorm = 0.0571, lr_0 = 9.1068e-04
Validation auc = 0.654986
Epoch 1802
Validation auc = 0.655751
Epoch 1803
Validation auc = 0.657391
Epoch 1804
Validation auc = 0.658375
Epoch 1805
Validation auc = 0.659414
Epoch 1806
Loss = 9.4355e-04, PNorm = 115.4490, GNorm = 0.0050, lr_0 = 9.1046e-04
Loss = 7.7748e-03, PNorm = 115.4521, GNorm = 0.2003, lr_0 = 9.1044e-04
Validation auc = 0.660070
Epoch 1807
Validation auc = 0.660781
Epoch 1808
Validation auc = 0.660617
Epoch 1809
Validation auc = 0.661109
Epoch 1810
Validation auc = 0.661327
Epoch 1811
Loss = 1.2199e-02, PNorm = 115.4863, GNorm = 1.0306, lr_0 = 9.1023e-04
Validation auc = 0.660343
Epoch 1812
Validation auc = 0.660343
Epoch 1813
Validation auc = 0.659250
Epoch 1814
Validation auc = 0.657446
Epoch 1815
Validation auc = 0.658047
Epoch 1816
Loss = 4.3043e-04, PNorm = 115.5195, GNorm = 0.0187, lr_0 = 9.0999e-04
Validation auc = 0.656243
Epoch 1817
Validation auc = 0.655314
Epoch 1818
Validation auc = 0.656735
Epoch 1819
Validation auc = 0.656462
Epoch 1820
Loss = 1.1462e-03, PNorm = 115.5624, GNorm = 0.0824, lr_0 = 9.0978e-04
Loss = 1.9048e-02, PNorm = 115.5713, GNorm = 1.7040, lr_0 = 9.0976e-04
Validation auc = 0.656845
Epoch 1821
Validation auc = 0.651159
Epoch 1822
Validation auc = 0.641811
Epoch 1823
Validation auc = 0.634758
Epoch 1824
Validation auc = 0.625410
Epoch 1825
Loss = 8.6668e-03, PNorm = 115.7481, GNorm = 0.3480, lr_0 = 9.0955e-04
Validation auc = 0.618248
Epoch 1826
Validation auc = 0.612508
Epoch 1827
Validation auc = 0.607369
Epoch 1828
Validation auc = 0.600590
Epoch 1829
Validation auc = 0.594850
Epoch 1830
Loss = 1.5184e-02, PNorm = 115.9277, GNorm = 0.6588, lr_0 = 9.0931e-04
Validation auc = 0.593155
Epoch 1831
Validation auc = 0.592718
Epoch 1832
Validation auc = 0.594522
Epoch 1833
Validation auc = 0.595998
Epoch 1834
Loss = 8.0577e-04, PNorm = 116.0216, GNorm = 0.0087, lr_0 = 9.0910e-04
Loss = 5.9604e-04, PNorm = 116.0268, GNorm = 0.0188, lr_0 = 9.0909e-04
Validation auc = 0.596873
Epoch 1835
Validation auc = 0.597584
Epoch 1836
Validation auc = 0.598130
Epoch 1837
Validation auc = 0.599114
Epoch 1838
Validation auc = 0.602449
Epoch 1839
Loss = 1.8372e-03, PNorm = 116.0842, GNorm = 0.0893, lr_0 = 9.0886e-04
Loss = 2.4337e-05, PNorm = 116.0894, GNorm = 0.0013, lr_0 = 9.0884e-04
Validation auc = 0.610048
Epoch 1840
Validation auc = 0.612672
Epoch 1841
Validation auc = 0.619232
Epoch 1842
Validation auc = 0.622677
Epoch 1843
Validation auc = 0.623497
Epoch 1844
Loss = 5.1918e-04, PNorm = 116.1273, GNorm = 0.0120, lr_0 = 9.0863e-04
Validation auc = 0.625082
Epoch 1845
Validation auc = 0.626121
Epoch 1846
Validation auc = 0.626394
Epoch 1847
Validation auc = 0.628635
Epoch 1848
Validation auc = 0.630276
Epoch 1849
Loss = 6.8075e-04, PNorm = 116.1496, GNorm = 0.0319, lr_0 = 9.0839e-04
Validation auc = 0.624590
Epoch 1850
Validation auc = 0.617975
Epoch 1851
Validation auc = 0.616554
Epoch 1852
Validation auc = 0.616772
Epoch 1853
Loss = 2.8530e-03, PNorm = 116.2046, GNorm = 0.7641, lr_0 = 9.0818e-04
Loss = 3.8200e-02, PNorm = 116.2087, GNorm = 3.9067, lr_0 = 9.0817e-04
Validation auc = 0.615788
Epoch 1854
Validation auc = 0.606932
Epoch 1855
Validation auc = 0.603925
Epoch 1856
Validation auc = 0.601301
Epoch 1857
Validation auc = 0.599497
Epoch 1858
Loss = 2.4318e-04, PNorm = 116.3125, GNorm = 0.0090, lr_0 = 9.0794e-04
Validation auc = 0.598732
Epoch 1859
Validation auc = 0.598568
Epoch 1860
Validation auc = 0.599333
Epoch 1861
Validation auc = 0.598896
Epoch 1862
Validation auc = 0.598240
Epoch 1863
Loss = 3.7813e-04, PNorm = 116.3762, GNorm = 0.0104, lr_0 = 9.0772e-04
Validation auc = 0.596108
Epoch 1864
Validation auc = 0.580035
Epoch 1865
Validation auc = 0.577302
Epoch 1866
Validation auc = 0.581128
Epoch 1867
Loss = 3.5506e-04, PNorm = 116.4618, GNorm = 0.0148, lr_0 = 9.0751e-04
Loss = 1.9868e-08, PNorm = 116.4674, GNorm = 0.0000, lr_0 = 9.0749e-04
Validation auc = 0.583206
Epoch 1868
Validation auc = 0.583698
Epoch 1869
Validation auc = 0.583370
Epoch 1870
Validation auc = 0.583698
Epoch 1871
Validation auc = 0.583534
Epoch 1872
Loss = 1.3031e-03, PNorm = 116.5132, GNorm = 0.1003, lr_0 = 9.0727e-04
Loss = 4.0540e-04, PNorm = 116.5154, GNorm = 0.0131, lr_0 = 9.0725e-04
Validation auc = 0.583206
Epoch 1873
Validation auc = 0.583862
Epoch 1874
Validation auc = 0.582823
Epoch 1875
Validation auc = 0.580199
Epoch 1876
Validation auc = 0.578122
Epoch 1877
Loss = 2.0999e-04, PNorm = 116.5447, GNorm = 0.0058, lr_0 = 9.0704e-04
Validation auc = 0.578286
Epoch 1878
Validation auc = 0.577247
Epoch 1879
Validation auc = 0.577684
Epoch 1880
Validation auc = 0.574349
Epoch 1881
Validation auc = 0.570031
Epoch 1882
Loss = 7.1074e-02, PNorm = 116.5809, GNorm = 3.8985, lr_0 = 9.0680e-04
Validation auc = 0.582768
Epoch 1883
Validation auc = 0.593101
Epoch 1884
Validation auc = 0.600098
Epoch 1885
Validation auc = 0.604527
Epoch 1886
Loss = 4.5038e-04, PNorm = 116.6402, GNorm = 0.0015, lr_0 = 9.0659e-04
Loss = 5.5829e-06, PNorm = 116.6436, GNorm = 0.0003, lr_0 = 9.0657e-04
Validation auc = 0.606932
Epoch 1887
Validation auc = 0.605183
Epoch 1888
Validation auc = 0.605784
Epoch 1889
Validation auc = 0.609009
Epoch 1890
Validation auc = 0.612344
Epoch 1891
Loss = 3.6454e-02, PNorm = 116.7072, GNorm = 0.5511, lr_0 = 9.0635e-04
Validation auc = 0.611798
Epoch 1892
Validation auc = 0.617866
Epoch 1893
Validation auc = 0.611360
Epoch 1894
Validation auc = 0.620162
Epoch 1895
Validation auc = 0.624481
Epoch 1896
Loss = 6.3504e-03, PNorm = 116.8036, GNorm = 0.1132, lr_0 = 9.0612e-04
Validation auc = 0.624754
Epoch 1897
Validation auc = 0.623005
Epoch 1898
Validation auc = 0.622185
Epoch 1899
Validation auc = 0.622075
Epoch 1900
Loss = 5.5071e-03, PNorm = 116.8953, GNorm = 0.0632, lr_0 = 9.0592e-04
Loss = 9.7710e-03, PNorm = 116.9024, GNorm = 0.2712, lr_0 = 9.0590e-04
Validation auc = 0.622841
Epoch 1901
Validation auc = 0.622731
Epoch 1902
Validation auc = 0.622567
Epoch 1903
Validation auc = 0.621802
Epoch 1904
Validation auc = 0.619314
Epoch 1905
Loss = 3.1695e-03, PNorm = 116.9732, GNorm = 0.0216, lr_0 = 9.0567e-04
Loss = 2.1496e-05, PNorm = 116.9767, GNorm = 0.0010, lr_0 = 9.0566e-04
Validation auc = 0.619260
Epoch 1906
Validation auc = 0.618904
Epoch 1907
Validation auc = 0.612016
Epoch 1908
Validation auc = 0.610267
Epoch 1909
Validation auc = 0.607643
Epoch 1910
Loss = 1.4187e-03, PNorm = 117.0084, GNorm = 0.0777, lr_0 = 9.0545e-04
Validation auc = 0.606057
Epoch 1911
Validation auc = 0.605237
Epoch 1912
Validation auc = 0.602449
Epoch 1913
Validation auc = 0.599388
Epoch 1914
Validation auc = 0.595998
Epoch 1915
Loss = 2.8591e-03, PNorm = 117.0497, GNorm = 0.0661, lr_0 = 9.0521e-04
Validation auc = 0.593046
Epoch 1916
Validation auc = 0.592663
Epoch 1917
Validation auc = 0.593155
Epoch 1918
Validation auc = 0.593647
Epoch 1919
Loss = 2.4219e-03, PNorm = 117.0879, GNorm = 0.0131, lr_0 = 9.0500e-04
Loss = 1.1027e-05, PNorm = 117.0907, GNorm = 0.0006, lr_0 = 9.0498e-04
Validation auc = 0.593593
Epoch 1920
Validation auc = 0.594850
Epoch 1921
Validation auc = 0.603789
Epoch 1922
Validation auc = 0.609337
Epoch 1923
Validation auc = 0.614094
Epoch 1924
Loss = 7.5288e-02, PNorm = 117.1182, GNorm = 0.0112, lr_0 = 9.0476e-04
Validation auc = 0.618959
Epoch 1925
Validation auc = 0.622294
Epoch 1926
Validation auc = 0.628581
Epoch 1927
Validation auc = 0.632790
Epoch 1928
Validation auc = 0.634977
Epoch 1929
Loss = 1.4008e-03, PNorm = 117.1573, GNorm = 0.0253, lr_0 = 9.0454e-04
Validation auc = 0.635305
Epoch 1930
Validation auc = 0.631970
Epoch 1931
Validation auc = 0.628034
Epoch 1932
Validation auc = 0.628581
Epoch 1933
Loss = 2.5592e-02, PNorm = 117.1959, GNorm = 0.2255, lr_0 = 9.0431e-04
Validation auc = 0.632025
Epoch 1934
Validation auc = 0.634376
Epoch 1935
Validation auc = 0.636617
Epoch 1936
Validation auc = 0.641209
Epoch 1937
Validation auc = 0.644872
Epoch 1938
Loss = 4.1344e-03, PNorm = 117.2578, GNorm = 0.0241, lr_0 = 9.0409e-04
Loss = 2.4552e-04, PNorm = 117.2616, GNorm = 0.0078, lr_0 = 9.0407e-04
Validation auc = 0.647168
Epoch 1939
Validation auc = 0.643997
Epoch 1940
Validation auc = 0.641865
Epoch 1941
Validation auc = 0.639952
Epoch 1942
Validation auc = 0.638913
Epoch 1943
Loss = 3.3200e-03, PNorm = 117.3069, GNorm = 0.1070, lr_0 = 9.0386e-04
Validation auc = 0.638913
Epoch 1944
Validation auc = 0.641373
Epoch 1945
Validation auc = 0.643068
Epoch 1946
Validation auc = 0.644817
Epoch 1947
Validation auc = 0.642959
Epoch 1948
Loss = 3.1279e-04, PNorm = 117.3608, GNorm = 0.0084, lr_0 = 9.0362e-04
Validation auc = 0.640444
Epoch 1949
Validation auc = 0.636070
Epoch 1950
Validation auc = 0.632736
Epoch 1951
Validation auc = 0.629346
Epoch 1952
Loss = 1.6636e-05, PNorm = 117.3856, GNorm = 0.0016, lr_0 = 9.0341e-04
Loss = 1.1881e-05, PNorm = 117.3868, GNorm = 0.0009, lr_0 = 9.0340e-04
Validation auc = 0.626777
Epoch 1953
Validation auc = 0.625957
Epoch 1954
Validation auc = 0.624317
Epoch 1955
Validation auc = 0.617592
Epoch 1956
Validation auc = 0.611798
Epoch 1957
Loss = 3.6527e-04, PNorm = 117.4050, GNorm = 0.0099, lr_0 = 9.0317e-04
Loss = 7.0333e-06, PNorm = 117.4071, GNorm = 0.0008, lr_0 = 9.0316e-04
Validation auc = 0.606221
Epoch 1958
Validation auc = 0.625246
Epoch 1959
Validation auc = 0.649738
Epoch 1960
Validation auc = 0.657938
Epoch 1961
Validation auc = 0.662585
Epoch 1962
Loss = 1.1820e-03, PNorm = 117.4746, GNorm = 0.0353, lr_0 = 9.0295e-04
Validation auc = 0.664935
Epoch 1963
Validation auc = 0.665810
Epoch 1964
Validation auc = 0.667122
Epoch 1965
Validation auc = 0.662585
Epoch 1966
Loss = 1.5502e-03, PNorm = 117.5653, GNorm = 0.0666, lr_0 = 9.0273e-04
Validation auc = 0.657883
Epoch 1967
Validation auc = 0.658157
Epoch 1968
Validation auc = 0.661382
Epoch 1969
Validation auc = 0.660671
Epoch 1970
Validation auc = 0.662202
Epoch 1971
Loss = 9.7818e-04, PNorm = 117.6946, GNorm = 0.0199, lr_0 = 9.0250e-04
Loss = 8.3644e-06, PNorm = 117.7013, GNorm = 0.0007, lr_0 = 9.0249e-04
Validation auc = 0.664935
Epoch 1972
Validation auc = 0.665756
Epoch 1973
Validation auc = 0.667669
Epoch 1974
Validation auc = 0.668708
Epoch 1975
Validation auc = 0.666685
Epoch 1976
Loss = 9.9882e-03, PNorm = 117.7916, GNorm = 0.6162, lr_0 = 9.0228e-04
Validation auc = 0.664170
Epoch 1977
Validation auc = 0.657227
Epoch 1978
Validation auc = 0.651159
Epoch 1979
Validation auc = 0.641975
Epoch 1980
Validation auc = 0.635086
Epoch 1981
Loss = 9.2782e-02, PNorm = 117.9106, GNorm = 1.8226, lr_0 = 9.0204e-04
Validation auc = 0.639843
Epoch 1982
Validation auc = 0.666193
Epoch 1983
Validation auc = 0.675213
Epoch 1984
Validation auc = 0.686694
Epoch 1985
Loss = 1.5703e-02, PNorm = 118.1242, GNorm = 0.1036, lr_0 = 9.0183e-04
Loss = 1.7971e-03, PNorm = 118.1584, GNorm = 0.0372, lr_0 = 9.0181e-04
Validation auc = 0.720534
Epoch 1986
Validation auc = 0.716597
Epoch 1987
Validation auc = 0.700579
Epoch 1988
Validation auc = 0.692325
Epoch 1989
Validation auc = 0.683086
Epoch 1990
Loss = 7.0612e-02, PNorm = 118.5864, GNorm = 0.7325, lr_0 = 9.0159e-04
Loss = 8.5427e-03, PNorm = 118.6112, GNorm = 0.2578, lr_0 = 9.0157e-04
Validation auc = 0.698283
Epoch 1991
Validation auc = 0.702165
Epoch 1992
Validation auc = 0.701509
Epoch 1993
Validation auc = 0.710693
Epoch 1994
Validation auc = 0.719440
Epoch 1995
Loss = 9.9361e-04, PNorm = 118.8864, GNorm = 0.0189, lr_0 = 9.0137e-04
Validation auc = 0.718784
Epoch 1996
Validation auc = 0.706046
Epoch 1997
Validation auc = 0.696370
Epoch 1998
Validation auc = 0.680899
Epoch 1999
Loss = 2.1472e-02, PNorm = 119.0341, GNorm = 0.0052, lr_0 = 9.0114e-04
Validation auc = 0.682375
Model 0 best validation auc = 0.781106 on epoch 778
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.579695
Ensemble test auc = 0.579695
Fold 9
Splitting data with seed 9
Class sizes
sars_cov_two_active 0: 98.39%, 1: 1.61%
Total size = 3,291 | train size = 3,291 | val size = 1,093 | test size = 1,084
With class_balance, effective train size = 106
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.1, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.1, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.1, inplace=False)
    (4): Linear(in_features=1200, out_features=1200, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.1, inplace=False)
    (7): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 6,100,801
Moving model to cuda
Epoch 0
Validation auc = 0.543626
Epoch 1
Validation auc = 0.615570
Epoch 2
Validation auc = 0.670348
Epoch 3
Validation auc = 0.555598
Epoch 4
Loss = 6.8672e-01, PNorm = 71.6132, GNorm = 1.2358, lr_0 = 2.0385e-04
Loss = 6.8529e-01, PNorm = 71.6144, GNorm = 2.9589, lr_0 = 2.1077e-04
Validation auc = 0.649902
Epoch 5
Validation auc = 0.524382
Epoch 6
Validation auc = 0.635742
Epoch 7
Validation auc = 0.545211
Epoch 8
Validation auc = 0.638421
Epoch 9
Loss = 7.1965e-01, PNorm = 71.6352, GNorm = 2.4024, lr_0 = 3.0077e-04
Validation auc = 0.557347
Epoch 10
Validation auc = 0.690356
Epoch 11
Validation auc = 0.646348
Epoch 12
Validation auc = 0.672316
Epoch 13
Validation auc = 0.659961
Epoch 14
Loss = 6.1501e-01, PNorm = 71.6754, GNorm = 0.7495, lr_0 = 4.0462e-04
Validation auc = 0.671878
Epoch 15
Validation auc = 0.688771
Epoch 16
Validation auc = 0.681992
Epoch 17
Validation auc = 0.642849
Epoch 18
Loss = 6.7082e-01, PNorm = 71.7277, GNorm = 0.6787, lr_0 = 4.9462e-04
Loss = 7.1623e-01, PNorm = 71.7322, GNorm = 3.1649, lr_0 = 5.0154e-04
Validation auc = 0.671714
Epoch 19
Validation auc = 0.669145
Epoch 20
Validation auc = 0.650230
Epoch 21
Validation auc = 0.652362
Epoch 22
Validation auc = 0.649628
Epoch 23
Loss = 6.7642e-01, PNorm = 71.8052, GNorm = 0.5919, lr_0 = 5.9846e-04
Loss = 6.3969e-01, PNorm = 71.8124, GNorm = 1.2714, lr_0 = 6.0538e-04
Validation auc = 0.654603
Epoch 24
Validation auc = 0.661491
Epoch 25
Validation auc = 0.646840
Epoch 26
Validation auc = 0.672972
Epoch 27
Validation auc = 0.669692
Epoch 28
Loss = 6.9330e-01, PNorm = 71.9205, GNorm = 0.5570, lr_0 = 6.9538e-04
Validation auc = 0.668817
Epoch 29
Validation auc = 0.665428
Epoch 30
Validation auc = 0.660125
Epoch 31
Validation auc = 0.659578
Epoch 32
Validation auc = 0.678111
Epoch 33
Loss = 7.2298e-01, PNorm = 72.0687, GNorm = 2.3116, lr_0 = 7.9923e-04
Validation auc = 0.660781
Epoch 34
Validation auc = 0.655314
Epoch 35
Validation auc = 0.632626
Epoch 36
Validation auc = 0.627269
Epoch 37
Loss = 6.6381e-01, PNorm = 72.1962, GNorm = 0.4910, lr_0 = 8.8923e-04
Loss = 6.4824e-01, PNorm = 72.2065, GNorm = 0.6859, lr_0 = 8.9615e-04
Validation auc = 0.609556
Epoch 38
Validation auc = 0.606604
Epoch 39
Validation auc = 0.614859
Epoch 40
Validation auc = 0.619287
Epoch 41
Validation auc = 0.623114
Epoch 42
Loss = 6.2071e-01, PNorm = 72.3722, GNorm = 0.7184, lr_0 = 9.8615e-04
Validation auc = 0.611798
Epoch 43
Validation auc = 0.592062
Epoch 44
Validation auc = 0.584408
Epoch 45
Validation auc = 0.569211
Epoch 46
Validation auc = 0.555653
Epoch 47
Loss = 6.3975e-01, PNorm = 72.6122, GNorm = 0.3686, lr_0 = 9.9977e-04
Validation auc = 0.578996
Epoch 48
Validation auc = 0.591078
Epoch 49
Validation auc = 0.605675
Epoch 50
Validation auc = 0.622239
Epoch 51
Loss = 5.9899e-01, PNorm = 72.8331, GNorm = 0.5801, lr_0 = 9.9954e-04
Loss = 7.3701e-01, PNorm = 72.8422, GNorm = 1.0609, lr_0 = 9.9952e-04
Validation auc = 0.638968
Epoch 52
Validation auc = 0.633938
Epoch 53
Validation auc = 0.645091
Epoch 54
Validation auc = 0.629948
Epoch 55
Validation auc = 0.621583
Epoch 56
Loss = 6.4397e-01, PNorm = 73.0137, GNorm = 0.2293, lr_0 = 9.9927e-04
Loss = 6.4839e-01, PNorm = 73.0311, GNorm = 0.4681, lr_0 = 9.9926e-04
Validation auc = 0.604199
Epoch 57
Validation auc = 0.604636
Epoch 58
Validation auc = 0.586213
Epoch 59
Validation auc = 0.594468
Epoch 60
Validation auc = 0.603816
Epoch 61
Loss = 5.9040e-01, PNorm = 73.2529, GNorm = 1.1798, lr_0 = 9.9903e-04
Validation auc = 0.561229
Epoch 62
Validation auc = 0.562049
Epoch 63
Validation auc = 0.595069
Epoch 64
Validation auc = 0.588345
Epoch 65
Validation auc = 0.594741
Epoch 66
Loss = 4.7573e-01, PNorm = 73.5345, GNorm = 0.8011, lr_0 = 9.9876e-04
Validation auc = 0.610540
Epoch 67
Validation auc = 0.606112
Epoch 68
Validation auc = 0.592609
Epoch 69
Validation auc = 0.580582
Epoch 70
Loss = 5.1976e-01, PNorm = 73.8565, GNorm = 1.1369, lr_0 = 9.9853e-04
Loss = 5.5054e-01, PNorm = 73.8844, GNorm = 2.1216, lr_0 = 9.9851e-04
Validation auc = 0.585338
Epoch 71
Validation auc = 0.622075
Epoch 72
Validation auc = 0.570577
Epoch 73
Validation auc = 0.541275
Epoch 74
Validation auc = 0.554997
Epoch 75
Loss = 5.8032e-01, PNorm = 74.2298, GNorm = 0.5830, lr_0 = 9.9828e-04
Validation auc = 0.578942
Epoch 76
Validation auc = 0.611196
Epoch 77
Validation auc = 0.614640
Epoch 78
Validation auc = 0.662585
Epoch 79
Validation auc = 0.676635
Epoch 80
Loss = 5.8975e-01, PNorm = 74.6325, GNorm = 1.0981, lr_0 = 9.9802e-04
Validation auc = 0.635414
Epoch 81
Validation auc = 0.637328
Epoch 82
Validation auc = 0.636234
Epoch 83
Validation auc = 0.655150
Epoch 84
Loss = 5.1751e-01, PNorm = 74.9402, GNorm = 1.0354, lr_0 = 9.9779e-04
Loss = 5.3534e-01, PNorm = 74.9651, GNorm = 0.4672, lr_0 = 9.9777e-04
Validation auc = 0.665701
Epoch 85
Validation auc = 0.672042
Epoch 86
Validation auc = 0.668052
Epoch 87
Validation auc = 0.673245
Epoch 88
Validation auc = 0.686256
Epoch 89
Loss = 3.4452e-01, PNorm = 75.2935, GNorm = 1.2571, lr_0 = 9.9752e-04
Loss = 6.5758e-01, PNorm = 75.3168, GNorm = 2.1834, lr_0 = 9.9750e-04
Validation auc = 0.676361
Epoch 90
Validation auc = 0.681609
Epoch 91
Validation auc = 0.659523
Epoch 92
Validation auc = 0.694894
Epoch 93
Validation auc = 0.685546
Epoch 94
Loss = 4.5400e-01, PNorm = 75.6722, GNorm = 1.6895, lr_0 = 9.9727e-04
Validation auc = 0.656407
Epoch 95
Validation auc = 0.625137
Epoch 96
Validation auc = 0.633993
Epoch 97
Validation auc = 0.656462
Epoch 98
Validation auc = 0.657555
Epoch 99
Loss = 4.0438e-01, PNorm = 76.0751, GNorm = 1.2602, lr_0 = 9.9701e-04
Validation auc = 0.650831
Epoch 100
Validation auc = 0.613438
Epoch 101
Validation auc = 0.626558
Epoch 102
Validation auc = 0.647059
Epoch 103
Loss = 4.1005e-01, PNorm = 76.4839, GNorm = 5.4796, lr_0 = 9.9678e-04
Loss = 4.2670e-01, PNorm = 76.5139, GNorm = 2.5032, lr_0 = 9.9676e-04
Validation auc = 0.631150
Epoch 104
Validation auc = 0.631533
Epoch 105
Validation auc = 0.629346
Epoch 106
Validation auc = 0.642685
Epoch 107
Validation auc = 0.653400
Epoch 108
Loss = 3.8510e-01, PNorm = 76.9783, GNorm = 3.8656, lr_0 = 9.9651e-04
Validation auc = 0.666685
Epoch 109
Validation auc = 0.687787
Epoch 110
Validation auc = 0.659195
Epoch 111
Validation auc = 0.661054
Epoch 112
Validation auc = 0.690356
Epoch 113
Loss = 3.9420e-01, PNorm = 77.3201, GNorm = 0.4876, lr_0 = 9.9627e-04
Validation auc = 0.676307
Epoch 114
Validation auc = 0.633337
Epoch 115
Validation auc = 0.677509
Epoch 116
Validation auc = 0.668872
Epoch 117
Loss = 3.1242e-01, PNorm = 77.6418, GNorm = 0.5451, lr_0 = 9.9604e-04
Loss = 4.2589e-01, PNorm = 77.6657, GNorm = 2.3993, lr_0 = 9.9602e-04
Validation auc = 0.682976
Epoch 118
Validation auc = 0.678165
Epoch 119
Validation auc = 0.679204
Epoch 120
Validation auc = 0.667450
Epoch 121
Validation auc = 0.656079
Epoch 122
Loss = 4.1131e-01, PNorm = 77.9801, GNorm = 3.0677, lr_0 = 9.9577e-04
Loss = 2.7274e-01, PNorm = 78.0053, GNorm = 2.4710, lr_0 = 9.9575e-04
Validation auc = 0.588345
Epoch 123
Validation auc = 0.592937
Epoch 124
Validation auc = 0.574787
Epoch 125
Validation auc = 0.587142
Epoch 126
Validation auc = 0.611415
Epoch 127
Loss = 3.0475e-01, PNorm = 78.3722, GNorm = 1.3755, lr_0 = 9.9552e-04
Validation auc = 0.613875
Epoch 128
Validation auc = 0.613602
Epoch 129
Validation auc = 0.617319
Epoch 130
Validation auc = 0.616663
Epoch 131
Validation auc = 0.628253
Epoch 132
Loss = 3.2672e-01, PNorm = 78.7527, GNorm = 2.2208, lr_0 = 9.9526e-04
Validation auc = 0.632353
Epoch 133
Validation auc = 0.636234
Epoch 134
Validation auc = 0.656353
Epoch 135
Validation auc = 0.665264
Epoch 136
Loss = 2.2607e-01, PNorm = 78.9930, GNorm = 1.5826, lr_0 = 9.9503e-04
Loss = 3.2789e-01, PNorm = 79.0144, GNorm = 8.8357, lr_0 = 9.9501e-04
Validation auc = 0.683523
Epoch 137
Validation auc = 0.681773
Epoch 138
Validation auc = 0.644708
Epoch 139
Validation auc = 0.653018
Epoch 140
Validation auc = 0.656735
Epoch 141
Loss = 3.1374e-01, PNorm = 79.2848, GNorm = 0.8997, lr_0 = 9.9477e-04
Validation auc = 0.664279
Epoch 142
Validation auc = 0.672917
Epoch 143
Validation auc = 0.679751
Epoch 144
Validation auc = 0.673628
Epoch 145
Validation auc = 0.663131
Epoch 146
Loss = 2.9539e-01, PNorm = 79.5332, GNorm = 2.5690, lr_0 = 9.9452e-04
Validation auc = 0.656790
Epoch 147
Validation auc = 0.659250
Epoch 148
Validation auc = 0.670949
Epoch 149
Validation auc = 0.678329
Epoch 150
Loss = 2.4021e-01, PNorm = 79.7892, GNorm = 2.1975, lr_0 = 9.9429e-04
Loss = 2.3320e-02, PNorm = 79.8077, GNorm = 0.2608, lr_0 = 9.9427e-04
Validation auc = 0.676088
Epoch 151
Validation auc = 0.676307
Epoch 152
Validation auc = 0.674065
Epoch 153
Validation auc = 0.672808
Epoch 154
Validation auc = 0.671222
Epoch 155
Loss = 1.0936e-01, PNorm = 80.0365, GNorm = 2.1612, lr_0 = 9.9403e-04
Loss = 1.7823e-02, PNorm = 80.0513, GNorm = 0.4839, lr_0 = 9.9401e-04
Validation auc = 0.667669
Epoch 156
Validation auc = 0.671824
Epoch 157
Validation auc = 0.674612
Epoch 158
Validation auc = 0.670785
Epoch 159
Validation auc = 0.662967
Epoch 160
Loss = 1.2580e-01, PNorm = 80.2677, GNorm = 0.9350, lr_0 = 9.9378e-04
Validation auc = 0.661655
Epoch 161
Validation auc = 0.673518
Epoch 162
Validation auc = 0.687022
Epoch 163
Validation auc = 0.688115
Epoch 164
Validation auc = 0.683632
Epoch 165
Loss = 1.4723e-01, PNorm = 80.5035, GNorm = 0.5585, lr_0 = 9.9351e-04
Validation auc = 0.688334
Epoch 166
Validation auc = 0.710365
Epoch 167
Validation auc = 0.714411
Epoch 168
Validation auc = 0.710147
Epoch 169
Loss = 8.1411e-02, PNorm = 80.7094, GNorm = 0.4300, lr_0 = 9.9329e-04
Loss = 1.7628e-01, PNorm = 80.7271, GNorm = 6.4792, lr_0 = 9.9327e-04
Validation auc = 0.709326
Epoch 170
Validation auc = 0.704406
Epoch 171
Validation auc = 0.708178
Epoch 172
Validation auc = 0.706812
Epoch 173
Validation auc = 0.699322
Epoch 174
Loss = 1.6582e-01, PNorm = 80.9903, GNorm = 2.2321, lr_0 = 9.9302e-04
Validation auc = 0.684124
Epoch 175
Validation auc = 0.685491
Epoch 176
Validation auc = 0.682101
Epoch 177
Validation auc = 0.670348
Epoch 178
Validation auc = 0.671332
Epoch 179
Loss = 1.6220e-01, PNorm = 81.2580, GNorm = 1.6576, lr_0 = 9.9277e-04
Validation auc = 0.652307
Epoch 180
Validation auc = 0.644435
Epoch 181
Validation auc = 0.638476
Epoch 182
Validation auc = 0.646020
Epoch 183
Loss = 1.8601e-01, PNorm = 81.5717, GNorm = 9.0805, lr_0 = 9.9253e-04
Validation auc = 0.665974
Epoch 184
Validation auc = 0.677892
Epoch 185
Validation auc = 0.699213
Epoch 186
Validation auc = 0.673737
Epoch 187
Validation auc = 0.650120
Epoch 188
Loss = 2.0456e-01, PNorm = 81.8521, GNorm = 1.4494, lr_0 = 9.9228e-04
Loss = 2.6253e-01, PNorm = 81.8742, GNorm = 2.0907, lr_0 = 9.9226e-04
Validation auc = 0.646949
Epoch 189
Validation auc = 0.655314
Epoch 190
Validation auc = 0.663186
Epoch 191
Validation auc = 0.646293
Epoch 192
Validation auc = 0.644927
Epoch 193
Loss = 1.1018e-01, PNorm = 82.1248, GNorm = 1.0437, lr_0 = 9.9204e-04
Validation auc = 0.636180
Epoch 194
Validation auc = 0.630276
Epoch 195
Validation auc = 0.622567
Epoch 196
Validation auc = 0.617210
Epoch 197
Validation auc = 0.626613
Epoch 198
Loss = 1.2392e-01, PNorm = 82.3589, GNorm = 0.5816, lr_0 = 9.9177e-04
Validation auc = 0.636726
Epoch 199
Validation auc = 0.634977
Epoch 200
Validation auc = 0.638093
Epoch 201
Validation auc = 0.642412
Epoch 202
Loss = 4.7636e-02, PNorm = 82.5705, GNorm = 0.5498, lr_0 = 9.9154e-04
Loss = 2.0442e-02, PNorm = 82.5847, GNorm = 0.5556, lr_0 = 9.9153e-04
Validation auc = 0.645255
Epoch 203
Validation auc = 0.641264
Epoch 204
Validation auc = 0.641537
Epoch 205
Validation auc = 0.644653
Epoch 206
Validation auc = 0.651924
Epoch 207
Loss = 7.8276e-02, PNorm = 82.7299, GNorm = 0.6832, lr_0 = 9.9128e-04
Loss = 5.0171e-03, PNorm = 82.7401, GNorm = 0.1133, lr_0 = 9.9126e-04
Validation auc = 0.660453
Epoch 208
Validation auc = 0.664935
Epoch 209
Validation auc = 0.667286
Epoch 210
Validation auc = 0.673190
Epoch 211
Validation auc = 0.674448
Epoch 212
Loss = 4.3889e-02, PNorm = 82.8760, GNorm = 2.2075, lr_0 = 9.9103e-04
Validation auc = 0.675487
Epoch 213
Validation auc = 0.677619
Epoch 214
Validation auc = 0.680953
Epoch 215
Validation auc = 0.681391
Epoch 216
Loss = 7.0436e-02, PNorm = 83.0226, GNorm = 0.2852, lr_0 = 9.9079e-04
Validation auc = 0.681609
Epoch 217
Validation auc = 0.684726
Epoch 218
Validation auc = 0.682867
Epoch 219
Validation auc = 0.688443
Epoch 220
Validation auc = 0.678001
Epoch 221
Loss = 2.2379e-01, PNorm = 83.1381, GNorm = 3.9590, lr_0 = 9.9054e-04
Loss = 4.4219e-02, PNorm = 83.1469, GNorm = 1.3245, lr_0 = 9.9052e-04
Validation auc = 0.668380
Epoch 222
Validation auc = 0.651651
Epoch 223
Validation auc = 0.652799
Epoch 224
Validation auc = 0.662366
Epoch 225
Validation auc = 0.662913
Epoch 226
Loss = 1.3703e-01, PNorm = 83.3018, GNorm = 1.2943, lr_0 = 9.9030e-04
Validation auc = 0.660015
Epoch 227
Validation auc = 0.653018
Epoch 228
Validation auc = 0.652362
Epoch 229
Validation auc = 0.649956
Epoch 230
Validation auc = 0.651378
Epoch 231
Loss = 1.3863e-01, PNorm = 83.4635, GNorm = 0.9899, lr_0 = 9.9003e-04
Validation auc = 0.652416
Epoch 232
Validation auc = 0.652471
Epoch 233
Validation auc = 0.653783
Epoch 234
Validation auc = 0.651323
Epoch 235
Loss = 8.5939e-02, PNorm = 83.5823, GNorm = 1.9764, lr_0 = 9.8980e-04
Loss = 8.7760e-02, PNorm = 83.5902, GNorm = 1.4145, lr_0 = 9.8979e-04
Validation auc = 0.656571
Epoch 236
Validation auc = 0.661983
Epoch 237
Validation auc = 0.664225
Epoch 238
Validation auc = 0.661382
Epoch 239
Validation auc = 0.662639
Epoch 240
Loss = 3.8330e-02, PNorm = 83.6917, GNorm = 0.4632, lr_0 = 9.8954e-04
Loss = 1.0687e-02, PNorm = 83.6976, GNorm = 1.3818, lr_0 = 9.8952e-04
Validation auc = 0.670785
Epoch 241
Validation auc = 0.688170
Epoch 242
Validation auc = 0.705062
Epoch 243
Validation auc = 0.713044
Epoch 244
Validation auc = 0.715176
Epoch 245
Loss = 8.9663e-03, PNorm = 83.7625, GNorm = 0.2623, lr_0 = 9.8930e-04
Validation auc = 0.717144
Epoch 246
Validation auc = 0.715176
Epoch 247
Validation auc = 0.710857
Epoch 248
Validation auc = 0.707741
Epoch 249
Loss = 2.6736e-02, PNorm = 83.8233, GNorm = 0.0169, lr_0 = 9.8905e-04
Validation auc = 0.705117
Epoch 250
Validation auc = 0.706429
Epoch 251
Validation auc = 0.706156
Epoch 252
Validation auc = 0.705008
Epoch 253
Validation auc = 0.694949
Epoch 254
Loss = 7.9332e-02, PNorm = 83.8626, GNorm = 1.9275, lr_0 = 9.8880e-04
Loss = 4.4951e-02, PNorm = 83.8643, GNorm = 1.0710, lr_0 = 9.8879e-04
Validation auc = 0.694183
Epoch 255
Validation auc = 0.695277
Epoch 256
Validation auc = 0.695167
Epoch 257
Validation auc = 0.688771
Epoch 258
Validation auc = 0.684015
Epoch 259
Loss = 1.1747e-02, PNorm = 83.9256, GNorm = 0.1869, lr_0 = 9.8856e-04
Validation auc = 0.679696
Epoch 260
Validation auc = 0.675159
Epoch 261
Validation auc = 0.669774
Epoch 262
Validation auc = 0.672753
Epoch 263
Validation auc = 0.678903
Epoch 264
Loss = 8.0781e-02, PNorm = 84.0388, GNorm = 0.5518, lr_0 = 9.8830e-04
Validation auc = 0.679669
Epoch 265
Validation auc = 0.680625
Epoch 266
Validation auc = 0.682457
Epoch 267
Validation auc = 0.678302
Epoch 268
Loss = 6.1732e-02, PNorm = 84.1762, GNorm = 0.0422, lr_0 = 9.8807e-04
Loss = 2.4697e-03, PNorm = 84.1855, GNorm = 0.0447, lr_0 = 9.8805e-04
Validation auc = 0.671878
Epoch 269
Validation auc = 0.661710
Epoch 270
Validation auc = 0.654740
Epoch 271
Validation auc = 0.642740
Epoch 272
Validation auc = 0.608791
Epoch 273
Loss = 3.5484e-01, PNorm = 84.3507, GNorm = 3.0051, lr_0 = 9.8781e-04
Loss = 3.5549e-02, PNorm = 84.3720, GNorm = 0.4735, lr_0 = 9.8779e-04
Validation auc = 0.561229
Epoch 274
Validation auc = 0.544992
Epoch 275
Validation auc = 0.545484
Epoch 276
Validation auc = 0.566860
Epoch 277
Validation auc = 0.594358
Epoch 278
Loss = 2.0247e-01, PNorm = 84.6823, GNorm = 1.3921, lr_0 = 9.8756e-04
Validation auc = 0.617920
Epoch 279
Validation auc = 0.631369
Epoch 280
Validation auc = 0.644817
Epoch 281
Validation auc = 0.647223
Epoch 282
Validation auc = 0.634813
Epoch 283
Loss = 1.0877e-01, PNorm = 84.9814, GNorm = 0.4293, lr_0 = 9.8730e-04
Validation auc = 0.631314
Epoch 284
Validation auc = 0.632517
Epoch 285
Validation auc = 0.630932
Epoch 286
Validation auc = 0.632025
Epoch 287
Loss = 1.0935e-01, PNorm = 85.1618, GNorm = 3.0300, lr_0 = 9.8707e-04
Loss = 2.6061e-02, PNorm = 85.1714, GNorm = 0.5680, lr_0 = 9.8705e-04
Validation auc = 0.630221
Epoch 288
Validation auc = 0.631260
Epoch 289
Validation auc = 0.635196
Epoch 290
Validation auc = 0.635086
Epoch 291
Validation auc = 0.645965
Epoch 292
Loss = 2.2379e-01, PNorm = 85.2985, GNorm = 1.1869, lr_0 = 9.8683e-04
Validation auc = 0.637656
Epoch 293
Validation auc = 0.634157
Epoch 294
Validation auc = 0.635469
Epoch 295
Validation auc = 0.654658
Epoch 296
Validation auc = 0.653674
Epoch 297
Loss = 1.2901e-01, PNorm = 85.5223, GNorm = 1.4227, lr_0 = 9.8656e-04
Validation auc = 0.639843
Epoch 298
Validation auc = 0.644325
Epoch 299
Validation auc = 0.658649
Epoch 300
Validation auc = 0.673792
Epoch 301
Loss = 2.1106e-01, PNorm = 85.7347, GNorm = 2.1898, lr_0 = 9.8634e-04
Loss = 7.3458e-03, PNorm = 85.7472, GNorm = 0.0886, lr_0 = 9.8632e-04
Validation auc = 0.666794
Epoch 302
Validation auc = 0.655915
Epoch 303
Validation auc = 0.672152
Epoch 304
Validation auc = 0.679259
Epoch 305
Validation auc = 0.678001
Epoch 306
Loss = 3.7599e-02, PNorm = 85.8837, GNorm = 0.2522, lr_0 = 9.8607e-04
Loss = 9.4934e-03, PNorm = 85.8920, GNorm = 0.1762, lr_0 = 9.8606e-04
Validation auc = 0.680571
Epoch 307
Validation auc = 0.680625
Epoch 308
Validation auc = 0.681008
Epoch 309
Validation auc = 0.684288
Epoch 310
Validation auc = 0.685928
Epoch 311
Loss = 9.0344e-02, PNorm = 85.9820, GNorm = 1.6313, lr_0 = 9.8583e-04
Validation auc = 0.685272
Epoch 312
Validation auc = 0.676471
Epoch 313
Validation auc = 0.671878
Epoch 314
Validation auc = 0.673026
Epoch 315
Validation auc = 0.672862
Epoch 316
Loss = 5.4318e-03, PNorm = 86.0505, GNorm = 0.0704, lr_0 = 9.8557e-04
Validation auc = 0.674120
Epoch 317
Validation auc = 0.677181
Epoch 318
Validation auc = 0.677783
Epoch 319
Validation auc = 0.678876
Epoch 320
Loss = 5.8979e-02, PNorm = 86.1017, GNorm = 1.4113, lr_0 = 9.8534e-04
Loss = 1.7963e-02, PNorm = 86.1070, GNorm = 0.5480, lr_0 = 9.8532e-04
Validation auc = 0.682812
Epoch 321
Validation auc = 0.691504
Epoch 322
Validation auc = 0.699486
Epoch 323
Validation auc = 0.704680
Epoch 324
Validation auc = 0.708944
Epoch 325
Loss = 1.0344e-01, PNorm = 86.1789, GNorm = 0.6004, lr_0 = 9.8509e-04
Validation auc = 0.713153
Epoch 326
Validation auc = 0.713372
Epoch 327
Validation auc = 0.708233
Epoch 328
Validation auc = 0.704953
Epoch 329
Validation auc = 0.710147
Epoch 330
Loss = 5.6043e-02, PNorm = 86.2228, GNorm = 1.0369, lr_0 = 9.8483e-04
Validation auc = 0.712771
Epoch 331
Validation auc = 0.710365
Epoch 332
Validation auc = 0.709818
Epoch 333
Validation auc = 0.710803
Epoch 334
Loss = 3.1369e-02, PNorm = 86.2684, GNorm = 0.1718, lr_0 = 9.8461e-04
Loss = 4.8439e-01, PNorm = 86.2722, GNorm = 5.3227, lr_0 = 9.8459e-04
Validation auc = 0.708178
Epoch 335
Validation auc = 0.692051
Epoch 336
Validation auc = 0.688443
Epoch 337
Validation auc = 0.689864
Epoch 338
Validation auc = 0.691559
Epoch 339
Loss = 3.2696e-02, PNorm = 86.3644, GNorm = 0.8350, lr_0 = 9.8434e-04
Loss = 3.2198e-03, PNorm = 86.3705, GNorm = 0.0772, lr_0 = 9.8433e-04
Validation auc = 0.693254
Epoch 340
Validation auc = 0.699814
Epoch 341
Validation auc = 0.701126
Epoch 342
Validation auc = 0.702056
Epoch 343
Validation auc = 0.701181
Epoch 344
Loss = 7.3871e-02, PNorm = 86.4561, GNorm = 1.2948, lr_0 = 9.8410e-04
Validation auc = 0.701728
Epoch 345
Validation auc = 0.704133
Epoch 346
Validation auc = 0.700962
Epoch 347
Validation auc = 0.699213
Epoch 348
Validation auc = 0.698666
Epoch 349
Loss = 5.1679e-03, PNorm = 86.5377, GNorm = 0.0749, lr_0 = 9.8384e-04
Validation auc = 0.698939
Epoch 350
Validation auc = 0.698557
Epoch 351
Validation auc = 0.697026
Epoch 352
Validation auc = 0.697627
Epoch 353
Loss = 9.6581e-03, PNorm = 86.5832, GNorm = 0.6813, lr_0 = 9.8361e-04
Loss = 3.7464e-02, PNorm = 86.5884, GNorm = 2.2566, lr_0 = 9.8359e-04
Validation auc = 0.701782
Epoch 354
Validation auc = 0.699814
Epoch 355
Validation auc = 0.694566
Epoch 356
Validation auc = 0.691122
Epoch 357
Validation auc = 0.689646
Epoch 358
Loss = 2.1119e-03, PNorm = 86.6483, GNorm = 0.0126, lr_0 = 9.8335e-04
Validation auc = 0.689099
Epoch 359
Validation auc = 0.689700
Epoch 360
Validation auc = 0.690411
Epoch 361
Validation auc = 0.690302
Epoch 362
Validation auc = 0.690356
Epoch 363
Loss = 4.5486e-02, PNorm = 86.6736, GNorm = 1.3339, lr_0 = 9.8311e-04
Validation auc = 0.693637
Epoch 364
Validation auc = 0.696643
Epoch 365
Validation auc = 0.698229
Epoch 366
Validation auc = 0.699103
Epoch 367
Loss = 1.6182e-02, PNorm = 86.7221, GNorm = 0.3678, lr_0 = 9.8288e-04
Loss = 5.1847e-03, PNorm = 86.7260, GNorm = 0.1054, lr_0 = 9.8286e-04
Validation auc = 0.700306
Epoch 368
Validation auc = 0.700962
Epoch 369
Validation auc = 0.699158
Epoch 370
Validation auc = 0.697682
Epoch 371
Validation auc = 0.691286
Epoch 372
Loss = 1.0993e-02, PNorm = 86.7659, GNorm = 0.2973, lr_0 = 9.8262e-04
Loss = 1.3090e-02, PNorm = 86.7699, GNorm = 0.8242, lr_0 = 9.8260e-04
Validation auc = 0.685874
Epoch 373
Validation auc = 0.681227
Epoch 374
Validation auc = 0.681664
Epoch 375
Validation auc = 0.683796
Epoch 376
Validation auc = 0.683960
Epoch 377
Loss = 4.7736e-03, PNorm = 86.8220, GNorm = 0.3053, lr_0 = 9.8237e-04
Validation auc = 0.683796
Epoch 378
Validation auc = 0.684398
Epoch 379
Validation auc = 0.684890
Epoch 380
Validation auc = 0.684234
Epoch 381
Validation auc = 0.685327
Epoch 382
Loss = 3.0177e-03, PNorm = 86.8583, GNorm = 0.0348, lr_0 = 9.8211e-04
Validation auc = 0.688552
Epoch 383
Validation auc = 0.690466
Epoch 384
Validation auc = 0.691286
Epoch 385
Validation auc = 0.691559
Epoch 386
Loss = 1.6371e-01, PNorm = 86.8804, GNorm = 1.1681, lr_0 = 9.8189e-04
Loss = 7.1840e-03, PNorm = 86.8807, GNorm = 0.1820, lr_0 = 9.8187e-04
Validation auc = 0.690903
Epoch 387
Validation auc = 0.691067
Epoch 388
Validation auc = 0.688443
Epoch 389
Validation auc = 0.688115
Epoch 390
Validation auc = 0.689208
Epoch 391
Loss = 5.2834e-03, PNorm = 86.9107, GNorm = 0.0872, lr_0 = 9.8163e-04
Validation auc = 0.691012
Epoch 392
Validation auc = 0.691559
Epoch 393
Validation auc = 0.692653
Epoch 394
Validation auc = 0.693527
Epoch 395
Validation auc = 0.694074
Epoch 396
Loss = 1.8586e-03, PNorm = 86.9473, GNorm = 0.0291, lr_0 = 9.8138e-04
Validation auc = 0.694183
Epoch 397
Validation auc = 0.693910
Epoch 398
Validation auc = 0.694402
Epoch 399
Validation auc = 0.694675
Epoch 400
Loss = 1.8314e-03, PNorm = 86.9745, GNorm = 0.0235, lr_0 = 9.8116e-04
Loss = 7.3948e-03, PNorm = 86.9771, GNorm = 1.1086, lr_0 = 9.8114e-04
Validation auc = 0.693527
Epoch 401
Validation auc = 0.689427
Epoch 402
Validation auc = 0.687787
Epoch 403
Validation auc = 0.687131
Epoch 404
Validation auc = 0.684944
Epoch 405
Loss = 6.4256e-02, PNorm = 87.0017, GNorm = 2.2232, lr_0 = 9.8089e-04
Loss = 8.7099e-04, PNorm = 87.0031, GNorm = 0.0231, lr_0 = 9.8088e-04
Validation auc = 0.687404
Epoch 406
Validation auc = 0.688826
Epoch 407
Validation auc = 0.688880
Epoch 408
Validation auc = 0.689427
Epoch 409
Validation auc = 0.690356
Epoch 410
Loss = 5.6441e-02, PNorm = 87.0240, GNorm = 1.5730, lr_0 = 9.8065e-04
Validation auc = 0.687623
Epoch 411
Validation auc = 0.684999
Epoch 412
Validation auc = 0.683086
Epoch 413
Validation auc = 0.684562
Epoch 414
Validation auc = 0.686366
Epoch 415
Loss = 3.5733e-02, PNorm = 87.0650, GNorm = 0.5270, lr_0 = 9.8039e-04
Validation auc = 0.689263
Epoch 416
Validation auc = 0.691067
Epoch 417
Validation auc = 0.692926
Epoch 418
Validation auc = 0.695605
Epoch 419
Loss = 3.1312e-03, PNorm = 87.0819, GNorm = 0.0170, lr_0 = 9.8016e-04
Loss = 1.2462e-03, PNorm = 87.0831, GNorm = 0.0347, lr_0 = 9.8015e-04
Validation auc = 0.697791
Epoch 420
Validation auc = 0.694894
Epoch 421
Validation auc = 0.693527
Epoch 422
Validation auc = 0.691559
Epoch 423
Validation auc = 0.691997
Epoch 424
Loss = 9.1855e-03, PNorm = 87.0880, GNorm = 0.0701, lr_0 = 9.7990e-04
Validation auc = 0.694675
Epoch 425
Validation auc = 0.697518
Epoch 426
Validation auc = 0.698721
Epoch 427
Validation auc = 0.698393
Epoch 428
Validation auc = 0.698393
Epoch 429
Loss = 3.5968e-03, PNorm = 87.1159, GNorm = 0.0448, lr_0 = 9.7966e-04
Validation auc = 0.697955
Epoch 430
Validation auc = 0.696042
Epoch 431
Validation auc = 0.693965
Epoch 432
Validation auc = 0.693090
Epoch 433
Loss = 1.8657e-03, PNorm = 87.1563, GNorm = 0.0350, lr_0 = 9.7942e-04
Validation auc = 0.691559
Epoch 434
Validation auc = 0.692379
Epoch 435
Validation auc = 0.692598
Epoch 436
Validation auc = 0.693527
Epoch 437
Validation auc = 0.694019
Epoch 438
Loss = 5.7324e-03, PNorm = 87.1715, GNorm = 0.0235, lr_0 = 9.7917e-04
Loss = 4.1164e-04, PNorm = 87.1725, GNorm = 0.0111, lr_0 = 9.7916e-04
Validation auc = 0.698611
Epoch 439
Validation auc = 0.701290
Epoch 440
Validation auc = 0.703258
Epoch 441
Validation auc = 0.704953
Epoch 442
Validation auc = 0.707468
Epoch 443
Loss = 1.3986e-03, PNorm = 87.1825, GNorm = 0.0222, lr_0 = 9.7893e-04
Validation auc = 0.709108
Epoch 444
Validation auc = 0.709873
Epoch 445
Validation auc = 0.708616
Epoch 446
Validation auc = 0.708452
Epoch 447
Validation auc = 0.708233
Epoch 448
Loss = 3.0030e-03, PNorm = 87.1989, GNorm = 0.0602, lr_0 = 9.7867e-04
Validation auc = 0.708178
Epoch 449
Validation auc = 0.708288
Epoch 450
Validation auc = 0.706320
Epoch 451
Validation auc = 0.705172
Epoch 452
Loss = 2.8534e-03, PNorm = 87.2184, GNorm = 0.0655, lr_0 = 9.7845e-04
Loss = 8.7860e-04, PNorm = 87.2199, GNorm = 0.0233, lr_0 = 9.7843e-04
Validation auc = 0.704953
Epoch 453
Validation auc = 0.704789
Epoch 454
Validation auc = 0.705008
Epoch 455
Validation auc = 0.705718
Epoch 456
Validation auc = 0.706812
Epoch 457
Loss = 4.3003e-04, PNorm = 87.2395, GNorm = 0.0080, lr_0 = 9.7819e-04
Loss = 2.0453e-04, PNorm = 87.2406, GNorm = 0.0050, lr_0 = 9.7817e-04
Validation auc = 0.707577
Epoch 458
Validation auc = 0.709873
Epoch 459
Validation auc = 0.711295
Epoch 460
Validation auc = 0.712388
Epoch 461
Validation auc = 0.713208
Epoch 462
Loss = 2.4084e-04, PNorm = 87.2518, GNorm = 0.0062, lr_0 = 9.7794e-04
Validation auc = 0.713919
Epoch 463
Validation auc = 0.716488
Epoch 464
Validation auc = 0.716324
Epoch 465
Validation auc = 0.716051
Epoch 466
Loss = 3.8522e-03, PNorm = 87.2587, GNorm = 0.0032, lr_0 = 9.7770e-04
Validation auc = 0.715067
Epoch 467
Validation auc = 0.715941
Epoch 468
Validation auc = 0.715613
Epoch 469
Validation auc = 0.709709
Epoch 470
Validation auc = 0.701564
Epoch 471
Loss = 5.9016e-02, PNorm = 87.2683, GNorm = 0.0337, lr_0 = 9.7746e-04
Loss = 1.0380e-03, PNorm = 87.2701, GNorm = 0.0254, lr_0 = 9.7744e-04
Validation auc = 0.696097
Epoch 472
Validation auc = 0.695058
Epoch 473
Validation auc = 0.695441
Epoch 474
Validation auc = 0.695222
Epoch 475
Validation auc = 0.695823
Epoch 476
Loss = 3.9152e-03, PNorm = 87.3199, GNorm = 0.0711, lr_0 = 9.7721e-04
Validation auc = 0.696643
Epoch 477
Validation auc = 0.695003
Epoch 478
Validation auc = 0.695987
Epoch 479
Validation auc = 0.696097
Epoch 480
Validation auc = 0.696425
Epoch 481
Loss = 9.6285e-04, PNorm = 87.3585, GNorm = 0.0169, lr_0 = 9.7695e-04
Validation auc = 0.696698
Epoch 482
Validation auc = 0.696370
Epoch 483
Validation auc = 0.696753
Epoch 484
Validation auc = 0.696425
Epoch 485
Loss = 2.7980e-02, PNorm = 87.3750, GNorm = 0.0458, lr_0 = 9.7673e-04
Loss = 1.3733e-03, PNorm = 87.3763, GNorm = 0.0360, lr_0 = 9.7671e-04
Validation auc = 0.695386
Epoch 486
Validation auc = 0.696315
Epoch 487
Validation auc = 0.696534
Epoch 488
Validation auc = 0.696807
Epoch 489
Validation auc = 0.697518
Epoch 490
Loss = 1.5750e-03, PNorm = 87.4023, GNorm = 0.0471, lr_0 = 9.7647e-04
Loss = 8.1341e-05, PNorm = 87.4041, GNorm = 0.0043, lr_0 = 9.7645e-04
Validation auc = 0.698338
Epoch 491
Validation auc = 0.700579
Epoch 492
Validation auc = 0.701946
Epoch 493
Validation auc = 0.700579
Epoch 494
Validation auc = 0.695222
Epoch 495
Loss = 2.8789e-03, PNorm = 87.4431, GNorm = 0.1800, lr_0 = 9.7623e-04
Validation auc = 0.688880
Epoch 496
Validation auc = 0.685491
Epoch 497
Validation auc = 0.681609
Epoch 498
Validation auc = 0.682265
Epoch 499
Loss = 2.2078e-02, PNorm = 87.5081, GNorm = 0.5523, lr_0 = 9.7599e-04
Validation auc = 0.685491
Epoch 500
Validation auc = 0.688334
Epoch 501
Validation auc = 0.691942
Epoch 502
Validation auc = 0.694019
Epoch 503
Validation auc = 0.694183
Epoch 504
Loss = 6.8861e-02, PNorm = 87.6441, GNorm = 1.3732, lr_0 = 9.7574e-04
Loss = 2.5255e-03, PNorm = 87.6516, GNorm = 0.0587, lr_0 = 9.7573e-04
Validation auc = 0.698338
Epoch 505
Validation auc = 0.710147
Epoch 506
Validation auc = 0.721900
Epoch 507
Validation auc = 0.716488
Epoch 508
Validation auc = 0.712060
Epoch 509
Loss = 9.5185e-03, PNorm = 87.8019, GNorm = 0.2082, lr_0 = 9.7550e-04
Validation auc = 0.709983
Epoch 510
Validation auc = 0.701072
Epoch 511
Validation auc = 0.697299
Epoch 512
Validation auc = 0.694402
Epoch 513
Validation auc = 0.695769
Epoch 514
Loss = 6.3955e-02, PNorm = 88.3125, GNorm = 0.3982, lr_0 = 9.7524e-04
Validation auc = 0.696643
Epoch 515
Validation auc = 0.692926
Epoch 516
Validation auc = 0.694238
Epoch 517
Validation auc = 0.699814
Epoch 518
Loss = 5.4132e-02, PNorm = 88.6700, GNorm = 0.5165, lr_0 = 9.7502e-04
Loss = 2.5638e-02, PNorm = 88.6905, GNorm = 0.6877, lr_0 = 9.7500e-04
Validation auc = 0.703805
Epoch 519
Validation auc = 0.720698
Epoch 520
Validation auc = 0.715613
Epoch 521
Validation auc = 0.701728
Epoch 522
Validation auc = 0.714028
Epoch 523
Loss = 6.1338e-02, PNorm = 88.9834, GNorm = 0.8888, lr_0 = 9.7476e-04
Loss = 1.2814e-02, PNorm = 89.0068, GNorm = 0.3365, lr_0 = 9.7474e-04
Validation auc = 0.725016
Epoch 524
Validation auc = 0.733107
Epoch 525
Validation auc = 0.741308
Epoch 526
Validation auc = 0.733435
Epoch 527
Validation auc = 0.722775
Epoch 528
Loss = 5.2420e-02, PNorm = 89.2677, GNorm = 1.6823, lr_0 = 9.7452e-04
Validation auc = 0.718784
Epoch 529
Validation auc = 0.714739
Epoch 530
Validation auc = 0.713099
Epoch 531
Validation auc = 0.710475
Epoch 532
Validation auc = 0.712169
Epoch 533
Loss = 1.5369e-02, PNorm = 89.4511, GNorm = 0.8003, lr_0 = 9.7426e-04
Validation auc = 0.714629
Epoch 534
Validation auc = 0.719276
Epoch 535
Validation auc = 0.720534
Epoch 536
Validation auc = 0.718784
Epoch 537
Loss = 3.8241e-02, PNorm = 89.5365, GNorm = 0.0676, lr_0 = 9.7403e-04
Loss = 3.3465e-03, PNorm = 89.5416, GNorm = 0.0797, lr_0 = 9.7401e-04
Validation auc = 0.712552
Epoch 538
Validation auc = 0.711076
Epoch 539
Validation auc = 0.724798
Epoch 540
Validation auc = 0.720588
Epoch 541
Validation auc = 0.720479
Epoch 542
Loss = 6.3217e-02, PNorm = 89.6577, GNorm = 1.2735, lr_0 = 9.7379e-04
Validation auc = 0.709709
Epoch 543
Validation auc = 0.727367
Epoch 544
Validation auc = 0.731085
Epoch 545
Validation auc = 0.724962
Epoch 546
Validation auc = 0.708616
Epoch 547
Loss = 1.1176e-01, PNorm = 90.3803, GNorm = 0.8881, lr_0 = 9.7353e-04
Validation auc = 0.691668
Epoch 548
Validation auc = 0.683523
Epoch 549
Validation auc = 0.682320
Epoch 550
Validation auc = 0.687623
Epoch 551
Loss = 1.3760e-01, PNorm = 90.9664, GNorm = 2.0806, lr_0 = 9.7331e-04
Loss = 2.8772e-02, PNorm = 90.9996, GNorm = 0.4778, lr_0 = 9.7329e-04
Validation auc = 0.695769
Epoch 552
Validation auc = 0.703258
Epoch 553
Validation auc = 0.710693
Epoch 554
Validation auc = 0.707194
Epoch 555
Validation auc = 0.711513
Epoch 556
Loss = 4.7430e-02, PNorm = 91.3247, GNorm = 1.1331, lr_0 = 9.7305e-04
Loss = 4.2614e-02, PNorm = 91.3469, GNorm = 2.0295, lr_0 = 9.7303e-04
Validation auc = 0.717417
Epoch 557
Validation auc = 0.716597
Epoch 558
Validation auc = 0.713591
Epoch 559
Validation auc = 0.708780
Epoch 560
Validation auc = 0.710147
Epoch 561
Loss = 2.3219e-02, PNorm = 91.5914, GNorm = 0.4111, lr_0 = 9.7281e-04
Validation auc = 0.716051
Epoch 562
Validation auc = 0.718894
Epoch 563
Validation auc = 0.719386
Epoch 564
Validation auc = 0.715832
Epoch 565
Validation auc = 0.710967
Epoch 566
Loss = 4.7959e-02, PNorm = 91.7568, GNorm = 1.1793, lr_0 = 9.7255e-04
Validation auc = 0.709873
Epoch 567
Validation auc = 0.709654
Epoch 568
Validation auc = 0.709764
Epoch 569
Validation auc = 0.704352
Epoch 570
Loss = 7.6499e-03, PNorm = 91.8482, GNorm = 0.1297, lr_0 = 9.7232e-04
Loss = 2.7375e-03, PNorm = 91.8561, GNorm = 0.0870, lr_0 = 9.7231e-04
Validation auc = 0.704516
Epoch 571
Validation auc = 0.703313
Epoch 572
Validation auc = 0.700142
Epoch 573
Validation auc = 0.698557
Epoch 574
Validation auc = 0.693527
Epoch 575
Loss = 1.6042e-01, PNorm = 91.9656, GNorm = 1.2938, lr_0 = 9.7208e-04
Validation auc = 0.690411
Epoch 576
Validation auc = 0.686311
Epoch 577
Validation auc = 0.684343
Epoch 578
Validation auc = 0.686202
Epoch 579
Validation auc = 0.687459
Epoch 580
Loss = 1.0111e-01, PNorm = 92.1177, GNorm = 1.1617, lr_0 = 9.7182e-04
Validation auc = 0.689318
Epoch 581
Validation auc = 0.690848
Epoch 582
Validation auc = 0.693227
Epoch 583
Validation auc = 0.695003
Epoch 584
Loss = 1.7747e-02, PNorm = 92.2438, GNorm = 1.2839, lr_0 = 9.7160e-04
Loss = 1.4555e-02, PNorm = 92.2526, GNorm = 0.7919, lr_0 = 9.7158e-04
Validation auc = 0.695386
Epoch 585
Validation auc = 0.689864
Epoch 586
Validation auc = 0.692379
Epoch 587
Validation auc = 0.694621
Epoch 588
Validation auc = 0.697245
Epoch 589
Loss = 7.0394e-02, PNorm = 92.3585, GNorm = 0.2006, lr_0 = 9.7134e-04
Loss = 7.5708e-04, PNorm = 92.3652, GNorm = 0.0198, lr_0 = 9.7132e-04
Validation auc = 0.698748
Epoch 590
Validation auc = 0.698939
Epoch 591
Validation auc = 0.699541
Epoch 592
Validation auc = 0.699841
Epoch 593
Validation auc = 0.700142
Epoch 594
Loss = 6.0641e-03, PNorm = 92.4425, GNorm = 0.0752, lr_0 = 9.7110e-04
Validation auc = 0.699923
Epoch 595
Validation auc = 0.704106
Epoch 596
Validation auc = 0.707932
Epoch 597
Validation auc = 0.710147
Epoch 598
Validation auc = 0.710119
Epoch 599
Loss = 1.4946e-02, PNorm = 92.5167, GNorm = 0.6897, lr_0 = 9.7084e-04
Validation auc = 0.712033
Epoch 600
Validation auc = 0.712907
Epoch 601
Validation auc = 0.714766
Epoch 602
Validation auc = 0.715285
Epoch 603
Loss = 1.8343e-03, PNorm = 92.5771, GNorm = 0.0386, lr_0 = 9.7062e-04
Loss = 1.4503e-04, PNorm = 92.5803, GNorm = 0.0060, lr_0 = 9.7060e-04
Validation auc = 0.716734
Epoch 604
Validation auc = 0.716023
Epoch 605
Validation auc = 0.713345
Epoch 606
Validation auc = 0.712169
Epoch 607
Validation auc = 0.714247
Epoch 608
Loss = 6.3054e-02, PNorm = 92.6288, GNorm = 1.1444, lr_0 = 9.7036e-04
Validation auc = 0.712279
Epoch 609
Validation auc = 0.712197
Epoch 610
Validation auc = 0.713536
Epoch 611
Validation auc = 0.714903
Epoch 612
Validation auc = 0.715285
Epoch 613
Loss = 1.4944e-01, PNorm = 92.6668, GNorm = 0.7865, lr_0 = 9.7012e-04
Validation auc = 0.713290
Epoch 614
Validation auc = 0.711459
Epoch 615
Validation auc = 0.706074
Epoch 616
Validation auc = 0.702602
Epoch 617
Loss = 3.6473e-02, PNorm = 92.6604, GNorm = 0.3079, lr_0 = 9.6990e-04
Loss = 3.5686e-02, PNorm = 92.6645, GNorm = 0.7250, lr_0 = 9.6988e-04
Validation auc = 0.704461
Epoch 618
Validation auc = 0.691997
Epoch 619
Validation auc = 0.678603
Epoch 620
Validation auc = 0.667669
Epoch 621
Validation auc = 0.661273
Epoch 622
Loss = 9.9077e-02, PNorm = 92.8345, GNorm = 1.0176, lr_0 = 9.6964e-04
Loss = 7.9655e-04, PNorm = 92.8488, GNorm = 0.0211, lr_0 = 9.6962e-04
Validation auc = 0.652416
Epoch 623
Validation auc = 0.653127
Epoch 624
Validation auc = 0.653510
Epoch 625
Validation auc = 0.657227
Epoch 626
Validation auc = 0.661655
Epoch 627
Loss = 1.7410e-02, PNorm = 93.0149, GNorm = 0.2225, lr_0 = 9.6940e-04
Validation auc = 0.664717
Epoch 628
Validation auc = 0.670074
Epoch 629
Validation auc = 0.671058
Epoch 630
Validation auc = 0.673464
Epoch 631
Validation auc = 0.673792
Epoch 632
Loss = 3.5043e-03, PNorm = 93.1605, GNorm = 0.0371, lr_0 = 9.6914e-04
Validation auc = 0.678111
Epoch 633
Validation auc = 0.682429
Epoch 634
Validation auc = 0.686229
Epoch 635
Validation auc = 0.690739
Epoch 636
Loss = 1.7135e-02, PNorm = 93.2317, GNorm = 0.1958, lr_0 = 9.6892e-04
Loss = 6.6867e-04, PNorm = 93.2359, GNorm = 0.0269, lr_0 = 9.6890e-04
Validation auc = 0.694949
Epoch 637
Validation auc = 0.697655
Epoch 638
Validation auc = 0.699404
Epoch 639
Validation auc = 0.699513
Epoch 640
Validation auc = 0.702602
Epoch 641
Loss = 5.2669e-03, PNorm = 93.2768, GNorm = 0.0723, lr_0 = 9.6866e-04
Validation auc = 0.708807
Epoch 642
Validation auc = 0.705992
Epoch 643
Validation auc = 0.708233
Epoch 644
Validation auc = 0.703176
Epoch 645
Validation auc = 0.692981
Epoch 646
Loss = 2.9193e-02, PNorm = 93.4032, GNorm = 0.3796, lr_0 = 9.6842e-04
Validation auc = 0.686475
Epoch 647
Validation auc = 0.683195
Epoch 648
Validation auc = 0.680789
Epoch 649
Validation auc = 0.681992
Epoch 650
Loss = 7.0598e-02, PNorm = 93.5777, GNorm = 0.4152, lr_0 = 9.6820e-04
Loss = 5.9715e-02, PNorm = 93.5893, GNorm = 0.9461, lr_0 = 9.6818e-04
Validation auc = 0.684398
Epoch 651
Validation auc = 0.683796
Epoch 652
Validation auc = 0.683851
Epoch 653
Validation auc = 0.686776
Epoch 654
Validation auc = 0.687213
Epoch 655
Loss = 4.3972e-03, PNorm = 93.7314, GNorm = 0.0689, lr_0 = 9.6794e-04
Loss = 3.4727e-04, PNorm = 93.7384, GNorm = 0.0102, lr_0 = 9.6792e-04
Validation auc = 0.690083
Epoch 656
Validation auc = 0.695495
Epoch 657
Validation auc = 0.698748
Epoch 658
Validation auc = 0.695468
Epoch 659
Validation auc = 0.697081
Epoch 660
Loss = 4.6006e-03, PNorm = 93.8151, GNorm = 0.1207, lr_0 = 9.6770e-04
Validation auc = 0.698092
Epoch 661
Validation auc = 0.702110
Epoch 662
Validation auc = 0.703450
Epoch 663
Validation auc = 0.704215
Epoch 664
Validation auc = 0.704871
Epoch 665
Loss = 7.0913e-03, PNorm = 93.8691, GNorm = 0.3081, lr_0 = 9.6744e-04
Validation auc = 0.703641
Epoch 666
Validation auc = 0.702001
Epoch 667
Validation auc = 0.701099
Epoch 668
Validation auc = 0.699322
Epoch 669
Loss = 7.5101e-03, PNorm = 93.9131, GNorm = 0.0223, lr_0 = 9.6722e-04
Loss = 6.6984e-05, PNorm = 93.9162, GNorm = 0.0033, lr_0 = 9.6720e-04
Validation auc = 0.700935
Epoch 670
Validation auc = 0.702930
Epoch 671
Validation auc = 0.703805
Epoch 672
Validation auc = 0.704816
Epoch 673
Validation auc = 0.707331
Epoch 674
Loss = 3.5910e-03, PNorm = 93.9572, GNorm = 0.0737, lr_0 = 9.6696e-04
Validation auc = 0.708424
Epoch 675
Validation auc = 0.709436
Epoch 676
Validation auc = 0.709764
Epoch 677
Validation auc = 0.703832
Epoch 678
Validation auc = 0.682566
Epoch 679
Loss = 4.0850e-01, PNorm = 94.0436, GNorm = 9.4172, lr_0 = 9.6672e-04
Validation auc = 0.673956
Epoch 680
Validation auc = 0.654111
Epoch 681
Validation auc = 0.638585
Epoch 682
Validation auc = 0.626995
Epoch 683
Loss = 7.9763e-02, PNorm = 94.2834, GNorm = 0.2296, lr_0 = 9.6648e-04
Validation auc = 0.619888
Epoch 684
Validation auc = 0.617538
Epoch 685
Validation auc = 0.627487
Epoch 686
Validation auc = 0.645856
Epoch 687
Validation auc = 0.666302
Epoch 688
Loss = 9.1652e-02, PNorm = 94.5482, GNorm = 2.4083, lr_0 = 9.6624e-04
Loss = 1.3462e-02, PNorm = 94.5682, GNorm = 0.3084, lr_0 = 9.6622e-04
Validation auc = 0.677072
Epoch 689
Validation auc = 0.681008
Epoch 690
Validation auc = 0.685874
Epoch 691
Validation auc = 0.696425
Epoch 692
Validation auc = 0.703586
Epoch 693
Loss = 7.2630e-02, PNorm = 94.7931, GNorm = 4.0405, lr_0 = 9.6600e-04
Validation auc = 0.705445
Epoch 694
Validation auc = 0.704024
Epoch 695
Validation auc = 0.704844
Epoch 696
Validation auc = 0.703313
Epoch 697
Validation auc = 0.666576
Epoch 698
Loss = 2.0415e-02, PNorm = 94.9588, GNorm = 0.6728, lr_0 = 9.6574e-04
Validation auc = 0.649355
Epoch 699
Validation auc = 0.662967
Epoch 700
Validation auc = 0.676361
Epoch 701
Validation auc = 0.687951
Epoch 702
Loss = 2.5714e-01, PNorm = 95.1251, GNorm = 1.5299, lr_0 = 9.6552e-04
Loss = 7.4976e-03, PNorm = 95.1396, GNorm = 0.2121, lr_0 = 9.6550e-04
Validation auc = 0.697682
Epoch 703
Validation auc = 0.701728
Epoch 704
Validation auc = 0.705226
Epoch 705
Validation auc = 0.708561
Epoch 706
Validation auc = 0.710475
Epoch 707
Loss = 3.4110e-02, PNorm = 95.3510, GNorm = 0.6780, lr_0 = 9.6526e-04
Loss = 9.9310e-03, PNorm = 95.3637, GNorm = 0.1814, lr_0 = 9.6525e-04
Validation auc = 0.711951
Epoch 708
Validation auc = 0.714739
Epoch 709
Validation auc = 0.714684
Epoch 710
Validation auc = 0.714903
Epoch 711
Validation auc = 0.715067
Epoch 712
Loss = 7.8446e-02, PNorm = 95.4802, GNorm = 1.0937, lr_0 = 9.6502e-04
Validation auc = 0.715996
Epoch 713
Validation auc = 0.716324
Epoch 714
Validation auc = 0.718784
Epoch 715
Validation auc = 0.720862
Epoch 716
Loss = 5.1652e-03, PNorm = 95.5499, GNorm = 0.0244, lr_0 = 9.6479e-04
Validation auc = 0.717609
Epoch 717
Validation auc = 0.718073
Epoch 718
Validation auc = 0.714438
Epoch 719
Validation auc = 0.713427
Epoch 720
Validation auc = 0.742674
Epoch 721
Loss = 9.7630e-02, PNorm = 95.7719, GNorm = 1.8951, lr_0 = 9.6455e-04
Loss = 2.2627e-02, PNorm = 95.8139, GNorm = 1.3584, lr_0 = 9.6453e-04
Validation auc = 0.747103
Epoch 722
Validation auc = 0.715504
Epoch 723
Validation auc = 0.697627
Epoch 724
Validation auc = 0.657063
Epoch 725
Validation auc = 0.629838
Epoch 726
Loss = 2.3898e-01, PNorm = 96.3149, GNorm = 7.3181, lr_0 = 9.6431e-04
Validation auc = 0.682211
Epoch 727
Validation auc = 0.692543
Epoch 728
Validation auc = 0.683086
Epoch 729
Validation auc = 0.675432
Epoch 730
Validation auc = 0.679751
Epoch 731
Loss = 1.2456e-01, PNorm = 96.7671, GNorm = 1.4628, lr_0 = 9.6405e-04
Validation auc = 0.686475
Epoch 732
Validation auc = 0.685382
Epoch 733
Validation auc = 0.688826
Epoch 734
Validation auc = 0.695769
Epoch 735
Loss = 7.5531e-02, PNorm = 97.0608, GNorm = 0.9667, lr_0 = 9.6383e-04
Loss = 4.3129e-03, PNorm = 97.0785, GNorm = 0.0944, lr_0 = 9.6381e-04
Validation auc = 0.694894
Epoch 736
Validation auc = 0.689974
Epoch 737
Validation auc = 0.685054
Epoch 738
Validation auc = 0.682375
Epoch 739
Validation auc = 0.681445
Epoch 740
Loss = 5.0317e-03, PNorm = 97.2547, GNorm = 0.1260, lr_0 = 9.6357e-04
Loss = 2.3342e-03, PNorm = 97.2617, GNorm = 0.0631, lr_0 = 9.6355e-04
Validation auc = 0.681555
Epoch 741
Validation auc = 0.681063
Epoch 742
Validation auc = 0.678165
Epoch 743
Validation auc = 0.677947
Epoch 744
Validation auc = 0.677947
Epoch 745
Loss = 3.6761e-03, PNorm = 97.3522, GNorm = 0.1590, lr_0 = 9.6333e-04
Validation auc = 0.677837
Epoch 746
Validation auc = 0.677345
Epoch 747
Validation auc = 0.677619
Epoch 748
Validation auc = 0.678876
Epoch 749
Loss = 2.8777e-03, PNorm = 97.4061, GNorm = 0.0377, lr_0 = 9.6309e-04
Validation auc = 0.676443
Epoch 750
Validation auc = 0.677373
Epoch 751
Validation auc = 0.678029
Epoch 752
Validation auc = 0.678575
Epoch 753
Validation auc = 0.678247
Epoch 754
Loss = 6.1770e-02, PNorm = 97.4940, GNorm = 0.0064, lr_0 = 9.6285e-04
Loss = 9.1323e-05, PNorm = 97.4990, GNorm = 0.0027, lr_0 = 9.6284e-04
Validation auc = 0.678275
Epoch 755
Validation auc = 0.681937
Epoch 756
Validation auc = 0.676361
Epoch 757
Validation auc = 0.670074
Epoch 758
Validation auc = 0.684070
Epoch 759
Loss = 3.5273e-02, PNorm = 97.5359, GNorm = 1.8780, lr_0 = 9.6262e-04
Validation auc = 0.706484
Epoch 760
Validation auc = 0.701400
Epoch 761
Validation auc = 0.674448
Epoch 762
Validation auc = 0.654330
Epoch 763
Validation auc = 0.650612
Epoch 764
Loss = 7.4962e-02, PNorm = 97.7517, GNorm = 0.8712, lr_0 = 9.6236e-04
Validation auc = 0.655696
Epoch 765
Validation auc = 0.661382
Epoch 766
Validation auc = 0.670074
Epoch 767
Validation auc = 0.672370
Epoch 768
Loss = 3.2254e-02, PNorm = 97.9537, GNorm = 0.3805, lr_0 = 9.6214e-04
Loss = 9.5466e-03, PNorm = 97.9691, GNorm = 0.1668, lr_0 = 9.6212e-04
Validation auc = 0.674557
Epoch 769
Validation auc = 0.668872
Epoch 770
Validation auc = 0.664771
Epoch 771
Validation auc = 0.671550
Epoch 772
Validation auc = 0.676744
Epoch 773
Loss = 1.8386e-01, PNorm = 98.1651, GNorm = 2.7709, lr_0 = 9.6188e-04
Loss = 2.1670e-03, PNorm = 98.1787, GNorm = 0.0474, lr_0 = 9.6186e-04
Validation auc = 0.689810
Epoch 774
Validation auc = 0.697627
Epoch 775
Validation auc = 0.701782
Epoch 776
Validation auc = 0.704406
Epoch 777
Validation auc = 0.703368
Epoch 778
Loss = 1.1443e-02, PNorm = 98.3230, GNorm = 0.3493, lr_0 = 9.6164e-04
Validation auc = 0.701509
Epoch 779
Validation auc = 0.699869
Epoch 780
Validation auc = 0.697846
Epoch 781
Validation auc = 0.696370
Epoch 782
Validation auc = 0.695113
Epoch 783
Loss = 1.3118e-03, PNorm = 98.4257, GNorm = 0.0192, lr_0 = 9.6139e-04
Validation auc = 0.695003
Epoch 784
Validation auc = 0.694730
Epoch 785
Validation auc = 0.692051
Epoch 786
Validation auc = 0.692762
Epoch 787
Loss = 3.8188e-02, PNorm = 98.4678, GNorm = 1.0877, lr_0 = 9.6117e-04
Loss = 2.5509e-03, PNorm = 98.4709, GNorm = 0.1390, lr_0 = 9.6115e-04
Validation auc = 0.694675
Epoch 788
Validation auc = 0.695277
Epoch 789
Validation auc = 0.694785
Epoch 790
Validation auc = 0.694183
Epoch 791
Validation auc = 0.693582
Epoch 792
Loss = 2.1172e-02, PNorm = 98.5233, GNorm = 1.4447, lr_0 = 9.6093e-04
Validation auc = 0.690466
Epoch 793
Validation auc = 0.685819
Epoch 794
Validation auc = 0.684616
Epoch 795
Validation auc = 0.681883
Epoch 796
Validation auc = 0.682429
Epoch 797
Loss = 1.4912e-02, PNorm = 98.5984, GNorm = 0.4338, lr_0 = 9.6067e-04
Validation auc = 0.683414
Epoch 798
Validation auc = 0.682703
Epoch 799
Validation auc = 0.683086
Epoch 800
Validation auc = 0.683742
Epoch 801
Loss = 9.4746e-04, PNorm = 98.6519, GNorm = 0.0223, lr_0 = 9.6045e-04
Loss = 1.3462e-03, PNorm = 98.6548, GNorm = 0.0503, lr_0 = 9.6043e-04
Validation auc = 0.684507
Epoch 802
Validation auc = 0.684671
Epoch 803
Validation auc = 0.684179
Epoch 804
Validation auc = 0.684452
Epoch 805
Validation auc = 0.682320
Epoch 806
Loss = 2.8141e-03, PNorm = 98.6728, GNorm = 0.3020, lr_0 = 9.6019e-04
Loss = 4.3612e-03, PNorm = 98.6762, GNorm = 0.0804, lr_0 = 9.6018e-04
Validation auc = 0.682757
Epoch 807
Validation auc = 0.687186
Epoch 808
Validation auc = 0.688826
Epoch 809
Validation auc = 0.691067
Epoch 810
Validation auc = 0.696807
Epoch 811
Loss = 1.8721e-02, PNorm = 98.9079, GNorm = 0.5267, lr_0 = 9.5996e-04
Validation auc = 0.695495
Epoch 812
Validation auc = 0.693582
Epoch 813
Validation auc = 0.700908
Epoch 814
Validation auc = 0.701564
Epoch 815
Validation auc = 0.699213
Epoch 816
Loss = 7.3358e-02, PNorm = 99.2152, GNorm = 0.9296, lr_0 = 9.5970e-04
Validation auc = 0.700197
Epoch 817
Validation auc = 0.697299
Epoch 818
Validation auc = 0.710967
Epoch 819
Validation auc = 0.723048
Epoch 820
Loss = 1.3609e-02, PNorm = 99.3751, GNorm = 0.0804, lr_0 = 9.5948e-04
Loss = 2.1412e-04, PNorm = 99.3840, GNorm = 0.0066, lr_0 = 9.5946e-04
Validation auc = 0.728789
Epoch 821
Validation auc = 0.732123
Epoch 822
Validation auc = 0.734365
Epoch 823
Validation auc = 0.732998
Epoch 824
Validation auc = 0.732889
Epoch 825
Loss = 4.2211e-02, PNorm = 99.4703, GNorm = 1.2316, lr_0 = 9.5924e-04
Validation auc = 0.728734
Epoch 826
Validation auc = 0.726492
Epoch 827
Validation auc = 0.723376
Epoch 828
Validation auc = 0.721299
Epoch 829
Validation auc = 0.720260
Epoch 830
Loss = 7.8297e-02, PNorm = 99.5428, GNorm = 1.4030, lr_0 = 9.5899e-04
Validation auc = 0.720588
Epoch 831
Validation auc = 0.719058
Epoch 832
Validation auc = 0.717964
Epoch 833
Validation auc = 0.716597
Epoch 834
Loss = 2.6780e-02, PNorm = 99.5826, GNorm = 1.1549, lr_0 = 9.5877e-04
Loss = 2.2912e-03, PNorm = 99.5848, GNorm = 0.0602, lr_0 = 9.5875e-04
Validation auc = 0.717800
Epoch 835
Validation auc = 0.718675
Epoch 836
Validation auc = 0.719495
Epoch 837
Validation auc = 0.719112
Epoch 838
Validation auc = 0.719714
Epoch 839
Loss = 1.1733e-01, PNorm = 99.6187, GNorm = 0.5774, lr_0 = 9.5851e-04
Loss = 4.0831e-04, PNorm = 99.6209, GNorm = 0.0108, lr_0 = 9.5849e-04
Validation auc = 0.724306
Epoch 840
Validation auc = 0.727640
Epoch 841
Validation auc = 0.730921
Epoch 842
Validation auc = 0.734583
Epoch 843
Validation auc = 0.737098
Epoch 844
Loss = 1.5831e-02, PNorm = 99.6756, GNorm = 0.5627, lr_0 = 9.5827e-04
Validation auc = 0.737809
Epoch 845
Validation auc = 0.738738
Epoch 846
Validation auc = 0.738520
Epoch 847
Validation auc = 0.736770
Epoch 848
Validation auc = 0.735075
Epoch 849
Loss = 1.8886e-03, PNorm = 99.7388, GNorm = 0.0360, lr_0 = 9.5802e-04
Validation auc = 0.733599
Epoch 850
Validation auc = 0.731358
Epoch 851
Validation auc = 0.729335
Epoch 852
Validation auc = 0.728242
Epoch 853
Loss = 3.0520e-02, PNorm = 99.7803, GNorm = 0.0212, lr_0 = 9.5780e-04
Loss = 3.5887e-04, PNorm = 99.7829, GNorm = 0.0120, lr_0 = 9.5778e-04
Validation auc = 0.727422
Epoch 854
Validation auc = 0.727258
Epoch 855
Validation auc = 0.725399
Epoch 856
Validation auc = 0.724962
Epoch 857
Validation auc = 0.724743
Epoch 858
Loss = 2.5258e-03, PNorm = 99.8145, GNorm = 0.0527, lr_0 = 9.5754e-04
Validation auc = 0.724634
Epoch 859
Validation auc = 0.724634
Epoch 860
Validation auc = 0.724251
Epoch 861
Validation auc = 0.724087
Epoch 862
Validation auc = 0.723650
Epoch 863
Loss = 5.0334e-03, PNorm = 99.8376, GNorm = 0.2812, lr_0 = 9.5730e-04
Validation auc = 0.724579
Epoch 864
Validation auc = 0.724415
Epoch 865
Validation auc = 0.724196
Epoch 866
Validation auc = 0.726383
Epoch 867
Loss = 1.3212e-03, PNorm = 99.8567, GNorm = 0.0165, lr_0 = 9.5708e-04
Loss = 8.0369e-04, PNorm = 99.8586, GNorm = 0.0351, lr_0 = 9.5707e-04
Validation auc = 0.729007
Epoch 868
Validation auc = 0.736114
Epoch 869
Validation auc = 0.724251
Epoch 870
Validation auc = 0.718894
Epoch 871
Validation auc = 0.722994
Epoch 872
Loss = 9.0655e-03, PNorm = 99.8566, GNorm = 0.1962, lr_0 = 9.5683e-04
Loss = 7.8339e-04, PNorm = 99.8618, GNorm = 0.0238, lr_0 = 9.5681e-04
Validation auc = 0.725563
Epoch 873
Validation auc = 0.726438
Epoch 874
Validation auc = 0.726930
Epoch 875
Validation auc = 0.723650
Epoch 876
Validation auc = 0.715832
Epoch 877
Loss = 2.6585e-02, PNorm = 99.9407, GNorm = 1.1043, lr_0 = 9.5659e-04
Validation auc = 0.706648
Epoch 878
Validation auc = 0.703750
Epoch 879
Validation auc = 0.705390
Epoch 880
Validation auc = 0.706538
Epoch 881
Validation auc = 0.706046
Epoch 882
Loss = 2.0355e-02, PNorm = 100.0765, GNorm = 1.0262, lr_0 = 9.5634e-04
Validation auc = 0.707686
Epoch 883
Validation auc = 0.706812
Epoch 884
Validation auc = 0.707304
Epoch 885
Validation auc = 0.708014
Epoch 886
Loss = 2.1862e-03, PNorm = 100.1727, GNorm = 0.0254, lr_0 = 9.5612e-04
Loss = 6.5545e-04, PNorm = 100.1804, GNorm = 0.0287, lr_0 = 9.5610e-04
Validation auc = 0.712443
Epoch 887
Validation auc = 0.715395
Epoch 888
Validation auc = 0.721354
Epoch 889
Validation auc = 0.722119
Epoch 890
Validation auc = 0.720206
Epoch 891
Loss = 3.2197e-03, PNorm = 100.2474, GNorm = 0.0495, lr_0 = 9.5586e-04
Validation auc = 0.717417
Epoch 892
Validation auc = 0.720424
Epoch 893
Validation auc = 0.721682
Epoch 894
Validation auc = 0.720534
Epoch 895
Validation auc = 0.720534
Epoch 896
Loss = 6.5518e-03, PNorm = 100.3177, GNorm = 0.1556, lr_0 = 9.5563e-04
Validation auc = 0.718565
Epoch 897
Validation auc = 0.717964
Epoch 898
Validation auc = 0.717417
Epoch 899
Validation auc = 0.715504
Epoch 900
Loss = 1.1656e-02, PNorm = 100.3544, GNorm = 0.2295, lr_0 = 9.5541e-04
Loss = 6.5227e-01, PNorm = 100.3562, GNorm = 7.4331, lr_0 = 9.5539e-04
Validation auc = 0.712333
Epoch 901
Validation auc = 0.709600
Epoch 902
Validation auc = 0.702110
Epoch 903
Validation auc = 0.699322
Epoch 904
Validation auc = 0.707632
Epoch 905
Loss = 5.2660e-02, PNorm = 100.4660, GNorm = 0.5777, lr_0 = 9.5515e-04
Loss = 6.6972e-02, PNorm = 100.4779, GNorm = 2.8273, lr_0 = 9.5513e-04
Validation auc = 0.715832
Epoch 906
Validation auc = 0.726274
Epoch 907
Validation auc = 0.737262
Epoch 908
Validation auc = 0.741690
Epoch 909
Validation auc = 0.745134
Epoch 910
Loss = 3.9062e-02, PNorm = 100.6640, GNorm = 0.8257, lr_0 = 9.5491e-04
Validation auc = 0.747431
Epoch 911
Validation auc = 0.741581
Epoch 912
Validation auc = 0.731085
Epoch 913
Validation auc = 0.740132
Epoch 914
Validation auc = 0.742374
Epoch 915
Loss = 1.0808e-02, PNorm = 100.8853, GNorm = 0.1647, lr_0 = 9.5466e-04
Validation auc = 0.745873
Epoch 916
Validation auc = 0.751886
Epoch 917
Validation auc = 0.754155
Epoch 918
Validation auc = 0.754811
Epoch 919
Loss = 3.7255e-02, PNorm = 101.0511, GNorm = 0.3059, lr_0 = 9.5444e-04
Loss = 1.9478e-04, PNorm = 101.0599, GNorm = 0.0070, lr_0 = 9.5442e-04
Validation auc = 0.753663
Epoch 920
Validation auc = 0.750847
Epoch 921
Validation auc = 0.736716
Epoch 922
Validation auc = 0.725727
Epoch 923
Validation auc = 0.723759
Epoch 924
Loss = 3.7520e-02, PNorm = 101.2276, GNorm = 0.8176, lr_0 = 9.5419e-04
Validation auc = 0.727312
Epoch 925
Validation auc = 0.728843
Epoch 926
Validation auc = 0.728898
Epoch 927
Validation auc = 0.729554
Epoch 928
Validation auc = 0.731959
Epoch 929
Loss = 8.5321e-03, PNorm = 101.4187, GNorm = 0.1116, lr_0 = 9.5395e-04
Validation auc = 0.735458
Epoch 930
Validation auc = 0.738738
Epoch 931
Validation auc = 0.737317
Epoch 932
Validation auc = 0.738000
Epoch 933
Loss = 5.5558e-03, PNorm = 101.5395, GNorm = 0.0478, lr_0 = 9.5371e-04
Validation auc = 0.737262
Epoch 934
Validation auc = 0.737590
Epoch 935
Validation auc = 0.736825
Epoch 936
Validation auc = 0.735239
Epoch 937
Validation auc = 0.734037
Epoch 938
Loss = 2.9379e-03, PNorm = 101.6279, GNorm = 0.0614, lr_0 = 9.5348e-04
Loss = 4.1421e-03, PNorm = 101.6336, GNorm = 0.1614, lr_0 = 9.5346e-04
Validation auc = 0.733463
Epoch 939
Validation auc = 0.735349
Epoch 940
Validation auc = 0.736141
Epoch 941
Validation auc = 0.735977
Epoch 942
Validation auc = 0.734665
Epoch 943
Loss = 2.7823e-04, PNorm = 101.7039, GNorm = 0.0067, lr_0 = 9.5324e-04
Validation auc = 0.732971
Epoch 944
Validation auc = 0.727367
Epoch 945
Validation auc = 0.722064
Epoch 946
Validation auc = 0.715777
Epoch 947
Validation auc = 0.711705
Epoch 948
Loss = 1.1241e-03, PNorm = 101.7590, GNorm = 0.0339, lr_0 = 9.5299e-04
Validation auc = 0.709545
Epoch 949
Validation auc = 0.702466
Epoch 950
Validation auc = 0.702001
Epoch 951
Validation auc = 0.700634
Epoch 952
Loss = 3.3628e-02, PNorm = 101.7874, GNorm = 0.8763, lr_0 = 9.5277e-04
Loss = 4.5620e-03, PNorm = 101.7916, GNorm = 0.1282, lr_0 = 9.5275e-04
Validation auc = 0.696561
Epoch 953
Validation auc = 0.700908
Epoch 954
Validation auc = 0.706265
Epoch 955
Validation auc = 0.712579
Epoch 956
Validation auc = 0.716406
Epoch 957
Loss = 6.2510e-03, PNorm = 101.8931, GNorm = 0.0566, lr_0 = 9.5251e-04
Loss = 2.0943e-02, PNorm = 101.9007, GNorm = 0.4266, lr_0 = 9.5250e-04
Validation auc = 0.720096
Epoch 958
Validation auc = 0.723322
Epoch 959
Validation auc = 0.725372
Epoch 960
Validation auc = 0.727039
Epoch 961
Validation auc = 0.730237
Epoch 962
Loss = 5.4929e-03, PNorm = 101.9878, GNorm = 0.1306, lr_0 = 9.5228e-04
Validation auc = 0.733709
Epoch 963
Validation auc = 0.731440
Epoch 964
Validation auc = 0.720916
Epoch 965
Validation auc = 0.695878
Epoch 966
Loss = 3.3367e-03, PNorm = 102.0635, GNorm = 0.1496, lr_0 = 9.5204e-04
Validation auc = 0.686311
Epoch 967
Validation auc = 0.679969
Epoch 968
Validation auc = 0.680899
Epoch 969
Validation auc = 0.679751
Epoch 970
Validation auc = 0.677673
Epoch 971
Loss = 8.0682e-03, PNorm = 102.1556, GNorm = 0.1198, lr_0 = 9.5180e-04
Loss = 5.2858e-03, PNorm = 102.1628, GNorm = 0.1815, lr_0 = 9.5179e-04
Validation auc = 0.674175
Epoch 972
Validation auc = 0.673518
Epoch 973
Validation auc = 0.674940
Epoch 974
Validation auc = 0.672480
Epoch 975
Validation auc = 0.665373
Epoch 976
Loss = 5.0522e-02, PNorm = 102.2241, GNorm = 0.8063, lr_0 = 9.5157e-04
Validation auc = 0.660125
Epoch 977
Validation auc = 0.661929
Epoch 978
Validation auc = 0.663186
Epoch 979
Validation auc = 0.662913
Epoch 980
Validation auc = 0.661983
Epoch 981
Loss = 3.0270e-03, PNorm = 102.2914, GNorm = 0.0624, lr_0 = 9.5132e-04
Validation auc = 0.661874
Epoch 982
Validation auc = 0.669473
Epoch 983
Validation auc = 0.679915
Epoch 984
Validation auc = 0.687623
Epoch 985
Loss = 6.6296e-03, PNorm = 102.3532, GNorm = 0.2256, lr_0 = 9.5110e-04
Loss = 3.4806e-03, PNorm = 102.3583, GNorm = 0.1069, lr_0 = 9.5108e-04
Validation auc = 0.690028
Epoch 986
Validation auc = 0.690848
Epoch 987
Validation auc = 0.689974
Epoch 988
Validation auc = 0.689755
Epoch 989
Validation auc = 0.689700
Epoch 990
Loss = 2.2248e-02, PNorm = 102.4197, GNorm = 0.9428, lr_0 = 9.5084e-04
Loss = 5.3494e-04, PNorm = 102.4227, GNorm = 0.0180, lr_0 = 9.5083e-04
Validation auc = 0.688716
Epoch 991
Validation auc = 0.687186
Epoch 992
Validation auc = 0.687076
Epoch 993
Validation auc = 0.686475
Epoch 994
Validation auc = 0.685108
Epoch 995
Loss = 3.0902e-03, PNorm = 102.4693, GNorm = 0.0781, lr_0 = 9.5061e-04
Validation auc = 0.682976
Epoch 996
Validation auc = 0.682211
Epoch 997
Validation auc = 0.684288
Epoch 998
Validation auc = 0.685382
Epoch 999
Loss = 3.8233e-03, PNorm = 102.5209, GNorm = 0.0026, lr_0 = 9.5037e-04
Validation auc = 0.686967
Epoch 1000
Validation auc = 0.696097
Epoch 1001
Validation auc = 0.705445
Epoch 1002
Validation auc = 0.710529
Epoch 1003
Validation auc = 0.714028
Epoch 1004
Loss = 9.1975e-03, PNorm = 102.5506, GNorm = 0.7735, lr_0 = 9.5014e-04
Loss = 7.6690e-04, PNorm = 102.5544, GNorm = 0.0283, lr_0 = 9.5012e-04
Validation auc = 0.716379
Epoch 1005
Validation auc = 0.715832
Epoch 1006
Validation auc = 0.714957
Epoch 1007
Validation auc = 0.715777
Epoch 1008
Validation auc = 0.714301
Epoch 1009
Loss = 8.3881e-02, PNorm = 102.5919, GNorm = 1.1443, lr_0 = 9.4990e-04
Validation auc = 0.713263
Epoch 1010
Validation auc = 0.712169
Epoch 1011
Validation auc = 0.713427
Epoch 1012
Validation auc = 0.714028
Epoch 1013
Validation auc = 0.712115
Epoch 1014
Loss = 9.4887e-04, PNorm = 102.6447, GNorm = 0.0163, lr_0 = 9.4965e-04
Validation auc = 0.708452
Epoch 1015
Validation auc = 0.705008
Epoch 1016
Validation auc = 0.702110
Epoch 1017
Validation auc = 0.699759
Epoch 1018
Loss = 1.6754e-03, PNorm = 102.6849, GNorm = 0.0319, lr_0 = 9.4943e-04
Loss = 4.0868e-04, PNorm = 102.6875, GNorm = 0.0183, lr_0 = 9.4941e-04
Validation auc = 0.698939
Epoch 1019
Validation auc = 0.697791
Epoch 1020
Validation auc = 0.697791
Epoch 1021
Validation auc = 0.697299
Epoch 1022
Validation auc = 0.697682
Epoch 1023
Loss = 2.4884e-04, PNorm = 102.7207, GNorm = 0.0044, lr_0 = 9.4918e-04
Loss = 4.6208e-05, PNorm = 102.7227, GNorm = 0.0044, lr_0 = 9.4916e-04
Validation auc = 0.698174
Epoch 1024
Validation auc = 0.697518
Epoch 1025
Validation auc = 0.695714
Epoch 1026
Validation auc = 0.699486
Epoch 1027
Validation auc = 0.701400
Epoch 1028
Loss = 5.0082e-03, PNorm = 102.7229, GNorm = 0.5044, lr_0 = 9.4894e-04
Validation auc = 0.701509
Epoch 1029
Validation auc = 0.698447
Epoch 1030
Validation auc = 0.696534
Epoch 1031
Validation auc = 0.695441
Epoch 1032
Validation auc = 0.694511
Epoch 1033
Loss = 2.7581e-03, PNorm = 102.7408, GNorm = 0.1394, lr_0 = 9.4869e-04
Validation auc = 0.692762
Epoch 1034
Validation auc = 0.692106
Epoch 1035
Validation auc = 0.692051
Epoch 1036
Validation auc = 0.693965
Epoch 1037
Loss = 1.3840e-03, PNorm = 102.7598, GNorm = 0.0101, lr_0 = 9.4847e-04
Loss = 8.3423e-04, PNorm = 102.7608, GNorm = 0.0259, lr_0 = 9.4845e-04
Validation auc = 0.694074
Epoch 1038
Validation auc = 0.694621
Epoch 1039
Validation auc = 0.695058
Epoch 1040
Validation auc = 0.696261
Epoch 1041
Validation auc = 0.697737
Epoch 1042
Loss = 8.2488e-04, PNorm = 102.7955, GNorm = 0.0189, lr_0 = 9.4823e-04
Validation auc = 0.698666
Epoch 1043
Validation auc = 0.699267
Epoch 1044
Validation auc = 0.700087
Epoch 1045
Validation auc = 0.700798
Epoch 1046
Validation auc = 0.700798
Epoch 1047
Loss = 3.0302e-03, PNorm = 102.8277, GNorm = 0.0861, lr_0 = 9.4798e-04
Validation auc = 0.701017
Epoch 1048
Validation auc = 0.700634
Epoch 1049
Validation auc = 0.703641
Epoch 1050
Validation auc = 0.707796
Epoch 1051
Loss = 1.1328e-01, PNorm = 102.8541, GNorm = 2.5670, lr_0 = 9.4776e-04
Loss = 4.0057e-04, PNorm = 102.8566, GNorm = 0.0147, lr_0 = 9.4775e-04
Validation auc = 0.707741
Epoch 1052
Validation auc = 0.704789
Epoch 1053
Validation auc = 0.698502
Epoch 1054
Validation auc = 0.694566
Epoch 1055
Validation auc = 0.691559
Epoch 1056
Loss = 1.1152e-02, PNorm = 102.8966, GNorm = 0.6652, lr_0 = 9.4751e-04
Loss = 5.9513e-04, PNorm = 102.8999, GNorm = 0.0269, lr_0 = 9.4749e-04
Validation auc = 0.690466
Epoch 1057
Validation auc = 0.689263
Epoch 1058
Validation auc = 0.689482
Epoch 1059
Validation auc = 0.690630
Epoch 1060
Validation auc = 0.693473
Epoch 1061
Loss = 6.9516e-03, PNorm = 102.9544, GNorm = 0.1037, lr_0 = 9.4728e-04
Validation auc = 0.695495
Epoch 1062
Validation auc = 0.697518
Epoch 1063
Validation auc = 0.697463
Epoch 1064
Validation auc = 0.696534
Epoch 1065
Validation auc = 0.694621
Epoch 1066
Loss = 2.9431e-03, PNorm = 103.0406, GNorm = 0.0544, lr_0 = 9.4702e-04
Validation auc = 0.693418
Epoch 1067
Validation auc = 0.690903
Epoch 1068
Validation auc = 0.688115
Epoch 1069
Validation auc = 0.686912
Epoch 1070
Loss = 9.4798e-04, PNorm = 103.1033, GNorm = 0.0368, lr_0 = 9.4681e-04
Loss = 8.6722e-04, PNorm = 103.1071, GNorm = 0.0252, lr_0 = 9.4679e-04
Validation auc = 0.686092
Epoch 1071
Validation auc = 0.685108
Epoch 1072
Validation auc = 0.683468
Epoch 1073
Validation auc = 0.685382
Epoch 1074
Validation auc = 0.686858
Epoch 1075
Loss = 5.5691e-02, PNorm = 103.1526, GNorm = 1.1317, lr_0 = 9.4657e-04
Validation auc = 0.684288
Epoch 1076
Validation auc = 0.690356
Epoch 1077
Validation auc = 0.699595
Epoch 1078
Validation auc = 0.698502
Epoch 1079
Validation auc = 0.698283
Epoch 1080
Loss = 5.3661e-04, PNorm = 103.1863, GNorm = 0.0124, lr_0 = 9.4632e-04
Validation auc = 0.697627
Epoch 1081
Validation auc = 0.694949
Epoch 1082
Validation auc = 0.693090
Epoch 1083
Validation auc = 0.694839
Epoch 1084
Loss = 1.0328e-03, PNorm = 103.2441, GNorm = 0.0959, lr_0 = 9.4610e-04
Loss = 1.6431e-04, PNorm = 103.2481, GNorm = 0.0089, lr_0 = 9.4608e-04
Validation auc = 0.696479
Epoch 1085
Validation auc = 0.698229
Epoch 1086
Validation auc = 0.697682
Epoch 1087
Validation auc = 0.698393
Epoch 1088
Validation auc = 0.698502
Epoch 1089
Loss = 3.5806e-04, PNorm = 103.2948, GNorm = 0.0073, lr_0 = 9.4585e-04
Loss = 9.3986e-04, PNorm = 103.2972, GNorm = 0.0418, lr_0 = 9.4583e-04
Validation auc = 0.698338
Epoch 1090
Validation auc = 0.698174
Epoch 1091
Validation auc = 0.700689
Epoch 1092
Validation auc = 0.702329
Epoch 1093
Validation auc = 0.704406
Epoch 1094
Loss = 5.8895e-03, PNorm = 103.3332, GNorm = 0.2667, lr_0 = 9.4561e-04
Validation auc = 0.706866
Epoch 1095
Validation auc = 0.708616
Epoch 1096
Validation auc = 0.709053
Epoch 1097
Validation auc = 0.709217
Epoch 1098
Validation auc = 0.709764
Epoch 1099
Loss = 1.2852e-01, PNorm = 103.3825, GNorm = 0.7512, lr_0 = 9.4536e-04
Validation auc = 0.710037
Epoch 1100
Validation auc = 0.710912
Epoch 1101
Validation auc = 0.712224
Epoch 1102
Validation auc = 0.713153
Epoch 1103
Loss = 6.6322e-04, PNorm = 103.3958, GNorm = 0.0110, lr_0 = 9.4515e-04
Loss = 7.7313e-04, PNorm = 103.3970, GNorm = 0.0226, lr_0 = 9.4513e-04
Validation auc = 0.713481
Epoch 1104
Validation auc = 0.714028
Epoch 1105
Validation auc = 0.714083
Epoch 1106
Validation auc = 0.716379
Epoch 1107
Validation auc = 0.717089
Epoch 1108
Loss = 1.0777e-03, PNorm = 103.4113, GNorm = 0.0350, lr_0 = 9.4489e-04
Validation auc = 0.717964
Epoch 1109
Validation auc = 0.718237
Epoch 1110
Validation auc = 0.718565
Epoch 1111
Validation auc = 0.718128
Epoch 1112
Validation auc = 0.717144
Epoch 1113
Loss = 8.7991e-04, PNorm = 103.4331, GNorm = 0.0227, lr_0 = 9.4466e-04
Validation auc = 0.716652
Epoch 1114
Validation auc = 0.715996
Epoch 1115
Validation auc = 0.715340
Epoch 1116
Validation auc = 0.715559
Epoch 1117
Loss = 1.2176e-03, PNorm = 103.4577, GNorm = 0.1391, lr_0 = 9.4444e-04
Loss = 2.3679e-03, PNorm = 103.4595, GNorm = 0.0661, lr_0 = 9.4443e-04
Validation auc = 0.714739
Epoch 1118
Validation auc = 0.714083
Epoch 1119
Validation auc = 0.713427
Epoch 1120
Validation auc = 0.713044
Epoch 1121
Validation auc = 0.712661
Epoch 1122
Loss = 1.7453e-04, PNorm = 103.4784, GNorm = 0.0024, lr_0 = 9.4419e-04
Loss = 3.9116e-05, PNorm = 103.4793, GNorm = 0.0019, lr_0 = 9.4417e-04
Validation auc = 0.712279
Epoch 1123
Validation auc = 0.712115
Epoch 1124
Validation auc = 0.711951
Epoch 1125
Validation auc = 0.711896
Epoch 1126
Validation auc = 0.712115
Epoch 1127
Loss = 1.9946e-04, PNorm = 103.4874, GNorm = 0.0043, lr_0 = 9.4396e-04
Validation auc = 0.712060
Epoch 1128
Validation auc = 0.712552
Epoch 1129
Validation auc = 0.723814
Epoch 1130
Validation auc = 0.727148
Epoch 1131
Validation auc = 0.729937
Epoch 1132
Loss = 3.0648e-03, PNorm = 103.5692, GNorm = 0.0666, lr_0 = 9.4371e-04
Validation auc = 0.722392
Epoch 1133
Validation auc = 0.714028
Epoch 1134
Validation auc = 0.712333
Epoch 1135
Validation auc = 0.716652
Epoch 1136
Loss = 1.1323e-02, PNorm = 103.7412, GNorm = 0.4205, lr_0 = 9.4349e-04
Loss = 1.3646e-03, PNorm = 103.7536, GNorm = 0.0299, lr_0 = 9.4347e-04
Validation auc = 0.721791
Epoch 1137
Validation auc = 0.726164
Epoch 1138
Validation auc = 0.729991
Epoch 1139
Validation auc = 0.733763
Epoch 1140
Validation auc = 0.736387
Epoch 1141
Loss = 6.2312e-03, PNorm = 103.8897, GNorm = 0.1456, lr_0 = 9.4324e-04
Validation auc = 0.737590
Epoch 1142
Validation auc = 0.739340
Epoch 1143
Validation auc = 0.739996
Epoch 1144
Validation auc = 0.740980
Epoch 1145
Validation auc = 0.742620
Epoch 1146
Loss = 5.0434e-03, PNorm = 103.9679, GNorm = 0.3553, lr_0 = 9.4300e-04
Validation auc = 0.744260
Epoch 1147
Validation auc = 0.745517
Epoch 1148
Validation auc = 0.746884
Epoch 1149
Validation auc = 0.750109
Epoch 1150
Loss = 2.6650e-03, PNorm = 104.0163, GNorm = 0.0531, lr_0 = 9.4279e-04
Loss = 5.7771e-05, PNorm = 104.0204, GNorm = 0.0028, lr_0 = 9.4277e-04
Validation auc = 0.756178
Epoch 1151
Validation auc = 0.743768
Epoch 1152
Validation auc = 0.731303
Epoch 1153
Validation auc = 0.723868
Epoch 1154
Validation auc = 0.720206
Epoch 1155
Loss = 4.9786e-02, PNorm = 104.0547, GNorm = 0.6658, lr_0 = 9.4253e-04
Loss = 2.1857e-04, PNorm = 104.0569, GNorm = 0.0084, lr_0 = 9.4252e-04
Validation auc = 0.717964
Epoch 1156
Validation auc = 0.715231
Epoch 1157
Validation auc = 0.713973
Epoch 1158
Validation auc = 0.715285
Epoch 1159
Validation auc = 0.715832
Epoch 1160
Loss = 1.2842e-03, PNorm = 104.0973, GNorm = 0.0315, lr_0 = 9.4230e-04
Validation auc = 0.718019
Epoch 1161
Validation auc = 0.715504
Epoch 1162
Validation auc = 0.710584
Epoch 1163
Validation auc = 0.719167
Epoch 1164
Validation auc = 0.727531
Epoch 1165
Loss = 1.9936e-03, PNorm = 104.1311, GNorm = 0.1074, lr_0 = 9.4205e-04
Validation auc = 0.730101
Epoch 1166
Validation auc = 0.743112
Epoch 1167
Validation auc = 0.749235
Epoch 1168
Validation auc = 0.753827
Epoch 1169
Loss = 2.0173e-02, PNorm = 104.1659, GNorm = 0.0255, lr_0 = 9.4183e-04
Loss = 4.2599e-03, PNorm = 104.1685, GNorm = 0.1059, lr_0 = 9.4182e-04
Validation auc = 0.747157
Epoch 1170
Validation auc = 0.741253
Epoch 1171
Validation auc = 0.744588
Epoch 1172
Validation auc = 0.747321
Epoch 1173
Validation auc = 0.746665
Epoch 1174
Loss = 9.9407e-03, PNorm = 104.2221, GNorm = 1.2633, lr_0 = 9.4158e-04
Validation auc = 0.743768
Epoch 1175
Validation auc = 0.740816
Epoch 1176
Validation auc = 0.733326
Epoch 1177
Validation auc = 0.729882
Epoch 1178
Validation auc = 0.732178
Epoch 1179
Loss = 6.2927e-03, PNorm = 104.2697, GNorm = 0.4572, lr_0 = 9.4135e-04
Validation auc = 0.730155
Epoch 1180
Validation auc = 0.729007
Epoch 1181
Validation auc = 0.729117
Epoch 1182
Validation auc = 0.728461
Epoch 1183
Loss = 1.5963e-03, PNorm = 104.3330, GNorm = 0.0010, lr_0 = 9.4112e-04
Validation auc = 0.731522
Epoch 1184
Validation auc = 0.733217
Epoch 1185
Validation auc = 0.732998
Epoch 1186
Validation auc = 0.733873
Epoch 1187
Validation auc = 0.732069
Epoch 1188
Loss = 1.3899e-04, PNorm = 104.3608, GNorm = 0.0014, lr_0 = 9.4088e-04
Loss = 1.1613e-03, PNorm = 104.3621, GNorm = 0.0696, lr_0 = 9.4087e-04
Validation auc = 0.729882
Epoch 1189
Validation auc = 0.727969
Epoch 1190
Validation auc = 0.730483
Epoch 1191
Validation auc = 0.729281
Epoch 1192
Validation auc = 0.730046
Epoch 1193
Loss = 1.9573e-03, PNorm = 104.3916, GNorm = 0.1542, lr_0 = 9.4065e-04
Validation auc = 0.733053
Epoch 1194
Validation auc = 0.734638
Epoch 1195
Validation auc = 0.737153
Epoch 1196
Validation auc = 0.740214
Epoch 1197
Validation auc = 0.740050
Epoch 1198
Loss = 5.5592e-03, PNorm = 104.4507, GNorm = 0.1478, lr_0 = 9.4040e-04
Validation auc = 0.739121
Epoch 1199
Validation auc = 0.737590
Epoch 1200
Validation auc = 0.736825
Epoch 1201
Validation auc = 0.736661
Epoch 1202
Loss = 1.4629e-03, PNorm = 104.4956, GNorm = 0.0706, lr_0 = 9.4018e-04
Loss = 3.1139e-04, PNorm = 104.4984, GNorm = 0.0115, lr_0 = 9.4016e-04
Validation auc = 0.734857
Epoch 1203
Validation auc = 0.733490
Epoch 1204
Validation auc = 0.730975
Epoch 1205
Validation auc = 0.729882
Epoch 1206
Validation auc = 0.729991
Epoch 1207
Loss = 1.2441e-03, PNorm = 104.5321, GNorm = 0.0335, lr_0 = 9.3993e-04
Loss = 1.0360e-04, PNorm = 104.5342, GNorm = 0.0073, lr_0 = 9.3991e-04
Validation auc = 0.729718
Epoch 1208
Validation auc = 0.730593
Epoch 1209
Validation auc = 0.731303
Epoch 1210
Validation auc = 0.729882
Epoch 1211
Validation auc = 0.731030
Epoch 1212
Loss = 1.9910e-03, PNorm = 104.5630, GNorm = 0.0531, lr_0 = 9.3970e-04
Validation auc = 0.731850
Epoch 1213
Validation auc = 0.734638
Epoch 1214
Validation auc = 0.738192
Epoch 1215
Validation auc = 0.737098
Epoch 1216
Loss = 6.4069e-02, PNorm = 104.6025, GNorm = 0.0018, lr_0 = 9.3946e-04
Validation auc = 0.737481
Epoch 1217
Validation auc = 0.734255
Epoch 1218
Validation auc = 0.730975
Epoch 1219
Validation auc = 0.727422
Epoch 1220
Validation auc = 0.721026
Epoch 1221
Loss = 9.5947e-02, PNorm = 104.6438, GNorm = 0.6942, lr_0 = 9.3923e-04
Loss = 4.6172e-04, PNorm = 104.6466, GNorm = 0.0158, lr_0 = 9.3922e-04
Validation auc = 0.715067
Epoch 1222
Validation auc = 0.713099
Epoch 1223
Validation auc = 0.710803
Epoch 1224
Validation auc = 0.709600
Epoch 1225
Validation auc = 0.707577
Epoch 1226
Loss = 2.9399e-03, PNorm = 104.6804, GNorm = 0.0592, lr_0 = 9.3900e-04
Validation auc = 0.707358
Epoch 1227
Validation auc = 0.707030
Epoch 1228
Validation auc = 0.708780
Epoch 1229
Validation auc = 0.709709
Epoch 1230
Validation auc = 0.710311
Epoch 1231
Loss = 4.7304e-03, PNorm = 104.7166, GNorm = 0.1234, lr_0 = 9.3875e-04
Validation auc = 0.711951
Epoch 1232
Validation auc = 0.713536
Epoch 1233
Validation auc = 0.716051
Epoch 1234
Validation auc = 0.720042
Epoch 1235
Loss = 1.6463e-03, PNorm = 104.7480, GNorm = 0.0469, lr_0 = 9.3853e-04
Loss = 1.3819e-03, PNorm = 104.7504, GNorm = 0.0413, lr_0 = 9.3852e-04
Validation auc = 0.722775
Epoch 1236
Validation auc = 0.724907
Epoch 1237
Validation auc = 0.726438
Epoch 1238
Validation auc = 0.726875
Epoch 1239
Validation auc = 0.726602
Epoch 1240
Loss = 6.5357e-04, PNorm = 104.7704, GNorm = 0.0157, lr_0 = 9.3828e-04
Loss = 3.2420e-04, PNorm = 104.7711, GNorm = 0.0119, lr_0 = 9.3827e-04
Validation auc = 0.727367
Epoch 1241
Validation auc = 0.727640
Epoch 1242
Validation auc = 0.727258
Epoch 1243
Validation auc = 0.727258
Epoch 1244
Validation auc = 0.727476
Epoch 1245
Loss = 8.9196e-04, PNorm = 104.7840, GNorm = 0.0166, lr_0 = 9.3805e-04
Validation auc = 0.727586
Epoch 1246
Validation auc = 0.724907
Epoch 1247
Validation auc = 0.720752
Epoch 1248
Validation auc = 0.719003
Epoch 1249
Loss = 6.7117e-04, PNorm = 104.8089, GNorm = 0.0045, lr_0 = 9.3782e-04
Validation auc = 0.716488
Epoch 1250
Validation auc = 0.721900
Epoch 1251
Validation auc = 0.728351
Epoch 1252
Validation auc = 0.732506
Epoch 1253
Validation auc = 0.736989
Epoch 1254
Loss = 1.5494e-03, PNorm = 104.8262, GNorm = 0.0114, lr_0 = 9.3758e-04
Loss = 3.2166e-04, PNorm = 104.8281, GNorm = 0.0122, lr_0 = 9.3757e-04
Validation auc = 0.736989
Epoch 1255
Validation auc = 0.738246
Epoch 1256
Validation auc = 0.738246
Epoch 1257
Validation auc = 0.739012
Epoch 1258
Validation auc = 0.739230
Epoch 1259
Loss = 1.9556e-04, PNorm = 104.8502, GNorm = 0.0067, lr_0 = 9.3735e-04
Validation auc = 0.739558
Epoch 1260
Validation auc = 0.739886
Epoch 1261
Validation auc = 0.739504
Epoch 1262
Validation auc = 0.740542
Epoch 1263
Validation auc = 0.741472
Epoch 1264
Loss = 7.7866e-04, PNorm = 104.8732, GNorm = 0.0273, lr_0 = 9.3710e-04
Validation auc = 0.740269
Epoch 1265
Validation auc = 0.737809
Epoch 1266
Validation auc = 0.736661
Epoch 1267
Validation auc = 0.734638
Epoch 1268
Loss = 1.8543e-03, PNorm = 104.8984, GNorm = 0.2011, lr_0 = 9.3689e-04
Loss = 2.3526e-04, PNorm = 104.9002, GNorm = 0.0142, lr_0 = 9.3687e-04
Validation auc = 0.732561
Epoch 1269
Validation auc = 0.730101
Epoch 1270
Validation auc = 0.729171
Epoch 1271
Validation auc = 0.727969
Epoch 1272
Validation auc = 0.729882
Epoch 1273
Loss = 4.4774e-03, PNorm = 104.9265, GNorm = 0.0333, lr_0 = 9.3664e-04
Loss = 5.3221e-04, PNorm = 104.9295, GNorm = 0.0196, lr_0 = 9.3662e-04
Validation auc = 0.731686
Epoch 1274
Validation auc = 0.734529
Epoch 1275
Validation auc = 0.735622
Epoch 1276
Validation auc = 0.737153
Epoch 1277
Validation auc = 0.737044
Epoch 1278
Loss = 1.6018e-03, PNorm = 104.9619, GNorm = 0.0312, lr_0 = 9.3641e-04
Validation auc = 0.737864
Epoch 1279
Validation auc = 0.738848
Epoch 1280
Validation auc = 0.739613
Epoch 1281
Validation auc = 0.740105
Epoch 1282
Validation auc = 0.739996
Epoch 1283
Loss = 3.9815e-03, PNorm = 104.9843, GNorm = 0.3467, lr_0 = 9.3616e-04
Validation auc = 0.739668
Epoch 1284
Validation auc = 0.739558
Epoch 1285
Validation auc = 0.738684
Epoch 1286
Validation auc = 0.738957
Epoch 1287
Loss = 5.1759e-04, PNorm = 105.0000, GNorm = 0.0148, lr_0 = 9.3594e-04
Loss = 1.5844e-04, PNorm = 105.0011, GNorm = 0.0088, lr_0 = 9.3592e-04
Validation auc = 0.739121
Epoch 1288
Validation auc = 0.739613
Epoch 1289
Validation auc = 0.739722
Epoch 1290
Validation auc = 0.739722
Epoch 1291
Validation auc = 0.739340
Epoch 1292
Loss = 2.0967e-04, PNorm = 105.0098, GNorm = 0.0048, lr_0 = 9.3571e-04
Validation auc = 0.739504
Epoch 1293
Validation auc = 0.739996
Epoch 1294
Validation auc = 0.740105
Epoch 1295
Validation auc = 0.739722
Epoch 1296
Validation auc = 0.741800
Epoch 1297
Loss = 1.7316e-02, PNorm = 105.0290, GNorm = 1.6726, lr_0 = 9.3546e-04
Validation auc = 0.747321
Epoch 1298
Validation auc = 0.741308
Epoch 1299
Validation auc = 0.736497
Epoch 1300
Validation auc = 0.736606
Epoch 1301
Loss = 5.6665e-02, PNorm = 105.1697, GNorm = 1.8145, lr_0 = 9.3524e-04
Loss = 1.5650e-01, PNorm = 105.1835, GNorm = 9.2311, lr_0 = 9.3523e-04
Validation auc = 0.728133
Epoch 1302
Validation auc = 0.720370
Epoch 1303
Validation auc = 0.718894
Epoch 1304
Validation auc = 0.729390
Epoch 1305
Validation auc = 0.740378
Epoch 1306
Loss = 4.8839e-02, PNorm = 105.4304, GNorm = 1.7417, lr_0 = 9.3499e-04
Loss = 1.4728e-04, PNorm = 105.4470, GNorm = 0.0058, lr_0 = 9.3498e-04
Validation auc = 0.743276
Epoch 1307
Validation auc = 0.737426
Epoch 1308
Validation auc = 0.735239
Epoch 1309
Validation auc = 0.740761
Epoch 1310
Validation auc = 0.745189
Epoch 1311
Loss = 1.1097e-02, PNorm = 105.6200, GNorm = 0.2891, lr_0 = 9.3476e-04
Validation auc = 0.744533
Epoch 1312
Validation auc = 0.732233
Epoch 1313
Validation auc = 0.723868
Epoch 1314
Validation auc = 0.754264
Epoch 1315
Validation auc = 0.765143
Epoch 1316
Loss = 1.0454e-03, PNorm = 105.7318, GNorm = 0.0187, lr_0 = 9.3451e-04
Validation auc = 0.769517
Epoch 1317
Validation auc = 0.771211
Epoch 1318
Validation auc = 0.767221
Epoch 1319
Validation auc = 0.765089
Epoch 1320
Loss = 3.8970e-02, PNorm = 105.7955, GNorm = 0.1091, lr_0 = 9.3430e-04
Loss = 5.5668e-03, PNorm = 105.8008, GNorm = 0.1243, lr_0 = 9.3428e-04
Validation auc = 0.761972
Epoch 1321
Validation auc = 0.760660
Epoch 1322
Validation auc = 0.760879
Epoch 1323
Validation auc = 0.762956
Epoch 1324
Validation auc = 0.764159
Epoch 1325
Loss = 1.1687e-03, PNorm = 105.8738, GNorm = 0.0306, lr_0 = 9.3407e-04
Validation auc = 0.766619
Epoch 1326
Validation auc = 0.768369
Epoch 1327
Validation auc = 0.767931
Epoch 1328
Validation auc = 0.764269
Epoch 1329
Validation auc = 0.761371
Epoch 1330
Loss = 1.6792e-02, PNorm = 105.9233, GNorm = 0.9962, lr_0 = 9.3382e-04
Validation auc = 0.758747
Epoch 1331
Validation auc = 0.762738
Epoch 1332
Validation auc = 0.759184
Epoch 1333
Validation auc = 0.756998
Epoch 1334
Loss = 8.0912e-04, PNorm = 105.9640, GNorm = 0.0115, lr_0 = 9.3360e-04
Loss = 2.6363e-04, PNorm = 105.9671, GNorm = 0.0188, lr_0 = 9.3359e-04
Validation auc = 0.755686
Epoch 1335
Validation auc = 0.753225
Epoch 1336
Validation auc = 0.750875
Epoch 1337
Validation auc = 0.750765
Epoch 1338
Validation auc = 0.750219
Epoch 1339
Loss = 2.3762e-02, PNorm = 106.0215, GNorm = 0.0222, lr_0 = 9.3336e-04
Loss = 2.5860e-04, PNorm = 106.0284, GNorm = 0.0109, lr_0 = 9.3334e-04
Validation auc = 0.746064
Epoch 1340
Validation auc = 0.747704
Epoch 1341
Validation auc = 0.749344
Epoch 1342
Validation auc = 0.750601
Epoch 1343
Validation auc = 0.749945
Epoch 1344
Loss = 2.5187e-03, PNorm = 106.1284, GNorm = 0.1522, lr_0 = 9.3312e-04
Validation auc = 0.742018
Epoch 1345
Validation auc = 0.734857
Epoch 1346
Validation auc = 0.729937
Epoch 1347
Validation auc = 0.728297
Epoch 1348
Validation auc = 0.730210
Epoch 1349
Loss = 1.5812e-02, PNorm = 106.1644, GNorm = 1.5588, lr_0 = 9.3288e-04
Validation auc = 0.733873
Epoch 1350
Validation auc = 0.731249
Epoch 1351
Validation auc = 0.734037
Epoch 1352
Validation auc = 0.734091
Epoch 1353
Loss = 2.3284e-02, PNorm = 106.2653, GNorm = 0.2533, lr_0 = 9.3266e-04
Loss = 1.9693e-03, PNorm = 106.2735, GNorm = 0.1205, lr_0 = 9.3264e-04
Validation auc = 0.729718
Epoch 1354
Validation auc = 0.723431
Epoch 1355
Validation auc = 0.719768
Epoch 1356
Validation auc = 0.713099
Epoch 1357
Validation auc = 0.710475
Epoch 1358
Loss = 1.9599e-03, PNorm = 106.3611, GNorm = 0.0156, lr_0 = 9.3241e-04
Validation auc = 0.709326
Epoch 1359
Validation auc = 0.714192
Epoch 1360
Validation auc = 0.736551
Epoch 1361
Validation auc = 0.741800
Epoch 1362
Validation auc = 0.740652
Epoch 1363
Loss = 2.0565e-03, PNorm = 106.4414, GNorm = 0.1002, lr_0 = 9.3218e-04
Validation auc = 0.740214
Epoch 1364
Validation auc = 0.747212
Epoch 1365
Validation auc = 0.734747
Epoch 1366
Validation auc = 0.710037
Epoch 1367
Loss = 7.2810e-02, PNorm = 106.5594, GNorm = 1.6333, lr_0 = 9.3197e-04
Loss = 5.0765e-02, PNorm = 106.5795, GNorm = 1.8072, lr_0 = 9.3195e-04
Validation auc = 0.721463
Epoch 1368
Validation auc = 0.717855
Epoch 1369
Validation auc = 0.730593
Epoch 1370
Validation auc = 0.730155
Epoch 1371
Validation auc = 0.734638
Epoch 1372
Loss = 4.5392e-02, PNorm = 106.9320, GNorm = 0.5283, lr_0 = 9.3172e-04
Loss = 1.2148e-02, PNorm = 106.9565, GNorm = 0.2558, lr_0 = 9.3170e-04
Validation auc = 0.731085
Epoch 1373
Validation auc = 0.739012
Epoch 1374
Validation auc = 0.755795
Epoch 1375
Validation auc = 0.764925
Epoch 1376
Validation auc = 0.776460
Epoch 1377
Loss = 5.4231e-03, PNorm = 107.2555, GNorm = 0.1444, lr_0 = 9.3149e-04
Validation auc = 0.778100
Epoch 1378
Validation auc = 0.783840
Epoch 1379
Validation auc = 0.784387
Epoch 1380
Validation auc = 0.781216
Epoch 1381
Validation auc = 0.778920
Epoch 1382
Loss = 3.8902e-03, PNorm = 107.4545, GNorm = 0.1190, lr_0 = 9.3124e-04
Validation auc = 0.774437
Epoch 1383
Validation auc = 0.764597
Epoch 1384
Validation auc = 0.757380
Epoch 1385
Validation auc = 0.748743
Epoch 1386
Loss = 9.7794e-02, PNorm = 107.5738, GNorm = 2.7015, lr_0 = 9.3102e-04
Loss = 3.8034e-03, PNorm = 107.5795, GNorm = 0.0800, lr_0 = 9.3101e-04
Validation auc = 0.740597
Epoch 1387
Validation auc = 0.735622
Epoch 1388
Validation auc = 0.734037
Epoch 1389
Validation auc = 0.732451
Epoch 1390
Validation auc = 0.733271
Epoch 1391
Loss = 5.8856e-03, PNorm = 107.6792, GNorm = 0.0323, lr_0 = 9.3078e-04
Validation auc = 0.733545
Epoch 1392
Validation auc = 0.735841
Epoch 1393
Validation auc = 0.738028
Epoch 1394
Validation auc = 0.739941
Epoch 1395
Validation auc = 0.739996
Epoch 1396
Loss = 9.9026e-04, PNorm = 107.7606, GNorm = 0.0364, lr_0 = 9.3055e-04
Validation auc = 0.734747
Epoch 1397
Validation auc = 0.730866
Epoch 1398
Validation auc = 0.727422
Epoch 1399
Validation auc = 0.729937
Epoch 1400
Loss = 2.8847e-04, PNorm = 107.8185, GNorm = 0.0127, lr_0 = 9.3033e-04
Loss = 2.5609e-05, PNorm = 107.8217, GNorm = 0.0014, lr_0 = 9.3032e-04
Validation auc = 0.734037
Epoch 1401
Validation auc = 0.736223
Epoch 1402
Validation auc = 0.741308
Epoch 1403
Validation auc = 0.744806
Epoch 1404
Validation auc = 0.747431
Epoch 1405
Loss = 8.1002e-02, PNorm = 107.8576, GNorm = 0.0999, lr_0 = 9.3008e-04
Loss = 8.3247e-06, PNorm = 107.8588, GNorm = 0.0004, lr_0 = 9.3007e-04
Validation auc = 0.741581
Epoch 1406
Validation auc = 0.725946
Epoch 1407
Validation auc = 0.752679
Epoch 1408
Validation auc = 0.752679
Epoch 1409
Validation auc = 0.750055
Epoch 1410
Loss = 1.8679e-02, PNorm = 107.9043, GNorm = 1.1236, lr_0 = 9.2985e-04
Validation auc = 0.744260
Epoch 1411
Validation auc = 0.740816
Epoch 1412
Validation auc = 0.740050
Epoch 1413
Validation auc = 0.737317
Epoch 1414
Validation auc = 0.734365
Epoch 1415
Loss = 1.8908e-02, PNorm = 107.9932, GNorm = 0.5670, lr_0 = 9.2961e-04
Validation auc = 0.736278
Epoch 1416
Validation auc = 0.741253
Epoch 1417
Validation auc = 0.743986
Epoch 1418
Validation auc = 0.748524
Epoch 1419
Loss = 9.9292e-03, PNorm = 108.0985, GNorm = 0.0797, lr_0 = 9.2939e-04
Loss = 4.7002e-03, PNorm = 108.1068, GNorm = 0.2890, lr_0 = 9.2938e-04
Validation auc = 0.751913
Epoch 1420
Validation auc = 0.753389
Epoch 1421
Validation auc = 0.756123
Epoch 1422
Validation auc = 0.755194
Epoch 1423
Validation auc = 0.756396
Epoch 1424
Loss = 2.3270e-02, PNorm = 108.1883, GNorm = 1.2068, lr_0 = 9.2914e-04
Validation auc = 0.757162
Epoch 1425
Validation auc = 0.757216
Epoch 1426
Validation auc = 0.757599
Epoch 1427
Validation auc = 0.756451
Epoch 1428
Validation auc = 0.754209
Epoch 1429
Loss = 1.0710e-03, PNorm = 108.2577, GNorm = 0.0245, lr_0 = 9.2891e-04
Validation auc = 0.753936
Epoch 1430
Validation auc = 0.752023
Epoch 1431
Validation auc = 0.752460
Epoch 1432
Validation auc = 0.751039
Epoch 1433
Loss = 1.2662e-02, PNorm = 108.2927, GNorm = 0.1615, lr_0 = 9.2868e-04
Validation auc = 0.742784
Epoch 1434
Validation auc = 0.744041
Epoch 1435
Validation auc = 0.754647
Epoch 1436
Validation auc = 0.761152
Epoch 1437
Validation auc = 0.767822
Epoch 1438
Loss = 1.3028e-03, PNorm = 108.3492, GNorm = 0.0105, lr_0 = 9.2845e-04
Loss = 1.0344e-03, PNorm = 108.3531, GNorm = 0.0339, lr_0 = 9.2844e-04
Validation auc = 0.772469
Epoch 1439
Validation auc = 0.768697
Epoch 1440
Validation auc = 0.764105
Epoch 1441
Validation auc = 0.761535
Epoch 1442
Validation auc = 0.761644
Epoch 1443
Loss = 6.2948e-03, PNorm = 108.3997, GNorm = 0.1474, lr_0 = 9.2822e-04
Validation auc = 0.762410
Epoch 1444
Validation auc = 0.762956
Epoch 1445
Validation auc = 0.764815
Epoch 1446
Validation auc = 0.765909
Epoch 1447
Validation auc = 0.771157
Epoch 1448
Loss = 4.6521e-04, PNorm = 108.4408, GNorm = 0.0298, lr_0 = 9.2798e-04
Validation auc = 0.773562
Epoch 1449
Validation auc = 0.775858
Epoch 1450
Validation auc = 0.776350
Epoch 1451
Validation auc = 0.767931
Epoch 1452
Loss = 1.1494e-03, PNorm = 108.4565, GNorm = 0.0235, lr_0 = 9.2776e-04
Loss = 2.1586e-04, PNorm = 108.4577, GNorm = 0.0069, lr_0 = 9.2775e-04
Validation auc = 0.765253
Epoch 1453
Validation auc = 0.765253
Epoch 1454
Validation auc = 0.764159
Epoch 1455
Validation auc = 0.763175
Epoch 1456
Validation auc = 0.762082
Epoch 1457
Loss = 5.2215e-03, PNorm = 108.4809, GNorm = 0.0512, lr_0 = 9.2752e-04
Loss = 5.3340e-04, PNorm = 108.4828, GNorm = 0.0236, lr_0 = 9.2750e-04
Validation auc = 0.761863
Epoch 1458
Validation auc = 0.762355
Epoch 1459
Validation auc = 0.763011
Epoch 1460
Validation auc = 0.763995
Epoch 1461
Validation auc = 0.765471
Epoch 1462
Loss = 1.2480e-03, PNorm = 108.5099, GNorm = 0.0645, lr_0 = 9.2729e-04
Validation auc = 0.764214
Epoch 1463
Validation auc = 0.762956
Epoch 1464
Validation auc = 0.762628
Epoch 1465
Validation auc = 0.762246
Epoch 1466
Loss = 4.8608e-02, PNorm = 108.5378, GNorm = 1.1505, lr_0 = 9.2706e-04
Validation auc = 0.759348
Epoch 1467
Validation auc = 0.759786
Epoch 1468
Validation auc = 0.760278
Epoch 1469
Validation auc = 0.762027
Epoch 1470
Validation auc = 0.761754
Epoch 1471
Loss = 2.1419e-03, PNorm = 108.5806, GNorm = 0.1329, lr_0 = 9.2683e-04
Loss = 3.3528e-04, PNorm = 108.5830, GNorm = 0.0203, lr_0 = 9.2681e-04
Validation auc = 0.761918
Epoch 1472
Validation auc = 0.761098
Epoch 1473
Validation auc = 0.761098
Epoch 1474
Validation auc = 0.761152
Epoch 1475
Validation auc = 0.761262
Epoch 1476
Loss = 4.9162e-05, PNorm = 108.6032, GNorm = 0.0017, lr_0 = 9.2660e-04
Validation auc = 0.760934
Epoch 1477
Validation auc = 0.760879
Epoch 1478
Validation auc = 0.760059
Epoch 1479
Validation auc = 0.758200
Epoch 1480
Validation auc = 0.757271
Epoch 1481
Loss = 5.1453e-04, PNorm = 108.6118, GNorm = 0.0145, lr_0 = 9.2635e-04
Validation auc = 0.756615
Epoch 1482
Validation auc = 0.756287
Epoch 1483
Validation auc = 0.754647
Epoch 1484
Validation auc = 0.747485
Epoch 1485
Loss = 9.1712e-02, PNorm = 108.6220, GNorm = 2.2461, lr_0 = 9.2614e-04
Loss = 4.0011e-01, PNorm = 108.6198, GNorm = 15.3316, lr_0 = 9.2612e-04
Validation auc = 0.747431
Epoch 1486
Validation auc = 0.739832
Epoch 1487
Validation auc = 0.717035
Epoch 1488
Validation auc = 0.695659
Epoch 1489
Validation auc = 0.676197
Epoch 1490
Loss = 4.1516e-02, PNorm = 108.7545, GNorm = 0.7255, lr_0 = 9.2589e-04
Loss = 3.9294e-03, PNorm = 108.7674, GNorm = 0.1103, lr_0 = 9.2587e-04
Validation auc = 0.670894
Epoch 1491
Validation auc = 0.673628
Epoch 1492
Validation auc = 0.678876
Epoch 1493
Validation auc = 0.685108
Epoch 1494
Validation auc = 0.685272
Epoch 1495
Loss = 2.1918e-02, PNorm = 108.9317, GNorm = 0.8033, lr_0 = 9.2566e-04
Validation auc = 0.686311
Epoch 1496
Validation auc = 0.686858
Epoch 1497
Validation auc = 0.688334
Epoch 1498
Validation auc = 0.689700
Epoch 1499
Loss = 6.2649e-03, PNorm = 109.0510, GNorm = 0.0159, lr_0 = 9.2543e-04
Validation auc = 0.690302
Epoch 1500
Validation auc = 0.699049
Epoch 1501
Validation auc = 0.702876
Epoch 1502
Validation auc = 0.695222
Epoch 1503
Validation auc = 0.693145
Epoch 1504
Loss = 1.2153e-03, PNorm = 109.1210, GNorm = 0.0573, lr_0 = 9.2520e-04
Loss = 6.8738e-04, PNorm = 109.1262, GNorm = 0.0400, lr_0 = 9.2518e-04
Validation auc = 0.688224
Epoch 1505
Validation auc = 0.685983
Epoch 1506
Validation auc = 0.684124
Epoch 1507
Validation auc = 0.682211
Epoch 1508
Validation auc = 0.679969
Epoch 1509
Loss = 5.1733e-02, PNorm = 109.2014, GNorm = 0.8364, lr_0 = 9.2497e-04
Validation auc = 0.676033
Epoch 1510
Validation auc = 0.676744
Epoch 1511
Validation auc = 0.679641
Epoch 1512
Validation auc = 0.684507
Epoch 1513
Validation auc = 0.712716
Epoch 1514
Loss = 1.5325e-02, PNorm = 109.2860, GNorm = 0.7546, lr_0 = 9.2472e-04
Validation auc = 0.711732
Epoch 1515
Validation auc = 0.718019
Epoch 1516
Validation auc = 0.721627
Epoch 1517
Validation auc = 0.721846
Epoch 1518
Loss = 7.0245e-03, PNorm = 109.3942, GNorm = 0.2824, lr_0 = 9.2451e-04
Loss = 4.1869e-03, PNorm = 109.4023, GNorm = 0.1817, lr_0 = 9.2449e-04
Validation auc = 0.721572
Epoch 1519
Validation auc = 0.724798
Epoch 1520
Validation auc = 0.729390
Epoch 1521
Validation auc = 0.724032
Epoch 1522
Validation auc = 0.720479
Epoch 1523
Loss = 6.3423e-03, PNorm = 109.5113, GNorm = 0.0460, lr_0 = 9.2427e-04
Loss = 7.7547e-04, PNorm = 109.5187, GNorm = 0.0331, lr_0 = 9.2425e-04
Validation auc = 0.721244
Epoch 1524
Validation auc = 0.722010
Epoch 1525
Validation auc = 0.721900
Epoch 1526
Validation auc = 0.713481
Epoch 1527
Validation auc = 0.706538
Epoch 1528
Loss = 5.1951e-04, PNorm = 109.5842, GNorm = 0.0138, lr_0 = 9.2404e-04
Validation auc = 0.713427
Epoch 1529
Validation auc = 0.728843
Epoch 1530
Validation auc = 0.739176
Epoch 1531
Validation auc = 0.748032
Epoch 1532
Validation auc = 0.752351
Epoch 1533
Loss = 5.3115e-04, PNorm = 109.7035, GNorm = 0.0182, lr_0 = 9.2379e-04
Validation auc = 0.754209
Epoch 1534
Validation auc = 0.755740
Epoch 1535
Validation auc = 0.755904
Epoch 1536
Validation auc = 0.752897
Epoch 1537
Loss = 3.5010e-03, PNorm = 109.7670, GNorm = 0.2035, lr_0 = 9.2358e-04
Loss = 1.0967e-05, PNorm = 109.7705, GNorm = 0.0008, lr_0 = 9.2356e-04
Validation auc = 0.749617
Epoch 1538
Validation auc = 0.747704
Epoch 1539
Validation auc = 0.744806
Epoch 1540
Validation auc = 0.743932
Epoch 1541
Validation auc = 0.743822
Epoch 1542
Loss = 1.3434e-03, PNorm = 109.7985, GNorm = 0.0349, lr_0 = 9.2335e-04
Validation auc = 0.743494
Epoch 1543
Validation auc = 0.743768
Epoch 1544
Validation auc = 0.743002
Epoch 1545
Validation auc = 0.740597
Epoch 1546
Validation auc = 0.743768
Epoch 1547
Loss = 1.1818e-03, PNorm = 109.8527, GNorm = 0.0270, lr_0 = 9.2310e-04
Validation auc = 0.749344
Epoch 1548
Validation auc = 0.754428
Epoch 1549
Validation auc = 0.757708
Epoch 1550
Validation auc = 0.760332
Epoch 1551
Loss = 6.4004e-02, PNorm = 109.9944, GNorm = 0.1178, lr_0 = 9.2289e-04
Loss = 2.9508e-01, PNorm = 110.0228, GNorm = 14.2665, lr_0 = 9.2287e-04
Validation auc = 0.719440
Epoch 1552
Validation auc = 0.707085
Epoch 1553
Validation auc = 0.729117
Epoch 1554
Validation auc = 0.727969
Epoch 1555
Validation auc = 0.731249
Epoch 1556
Loss = 6.4219e-02, PNorm = 110.5162, GNorm = 1.1524, lr_0 = 9.2264e-04
Loss = 5.4230e-03, PNorm = 110.5496, GNorm = 0.1298, lr_0 = 9.2263e-04
Validation auc = 0.733818
Epoch 1557
Validation auc = 0.727914
Epoch 1558
Validation auc = 0.717363
Epoch 1559
Validation auc = 0.711240
Epoch 1560
Validation auc = 0.705773
Epoch 1561
Loss = 2.8263e-03, PNorm = 110.8796, GNorm = 0.0439, lr_0 = 9.2242e-04
Validation auc = 0.701673
Epoch 1562
Validation auc = 0.699869
Epoch 1563
Validation auc = 0.699978
Epoch 1564
Validation auc = 0.702001
Epoch 1565
Validation auc = 0.704297
Epoch 1566
Loss = 2.2871e-02, PNorm = 111.0598, GNorm = 0.3550, lr_0 = 9.2217e-04
Validation auc = 0.704570
Epoch 1567
Validation auc = 0.704406
Epoch 1568
Validation auc = 0.701892
Epoch 1569
Validation auc = 0.697846
Epoch 1570
Loss = 3.4645e-03, PNorm = 111.1480, GNorm = 0.1479, lr_0 = 9.2196e-04
Loss = 2.6582e-05, PNorm = 111.1535, GNorm = 0.0012, lr_0 = 9.2194e-04
Validation auc = 0.690083
Epoch 1571
Validation auc = 0.694347
Epoch 1572
Validation auc = 0.702165
Epoch 1573
Validation auc = 0.703969
Epoch 1574
Validation auc = 0.705828
Epoch 1575
Loss = 3.5499e-04, PNorm = 111.2244, GNorm = 0.0103, lr_0 = 9.2173e-04
Validation auc = 0.707522
Epoch 1576
Validation auc = 0.705500
Epoch 1577
Validation auc = 0.706702
Epoch 1578
Validation auc = 0.710529
Epoch 1579
Validation auc = 0.712825
Epoch 1580
Loss = 6.7850e-02, PNorm = 111.3071, GNorm = 2.6849, lr_0 = 9.2148e-04
Validation auc = 0.716215
Epoch 1581
Validation auc = 0.717253
Epoch 1582
Validation auc = 0.719167
Epoch 1583
Validation auc = 0.719058
Epoch 1584
Loss = 4.1726e-02, PNorm = 111.3743, GNorm = 0.1498, lr_0 = 9.2127e-04
Loss = 6.2341e-03, PNorm = 111.3787, GNorm = 0.1695, lr_0 = 9.2125e-04
Validation auc = 0.719386
Epoch 1585
Validation auc = 0.719386
Epoch 1586
Validation auc = 0.719386
Epoch 1587
Validation auc = 0.720370
Epoch 1588
Validation auc = 0.721354
Epoch 1589
Loss = 3.3132e-03, PNorm = 111.4370, GNorm = 0.0465, lr_0 = 9.2103e-04
Loss = 9.7909e-04, PNorm = 111.4437, GNorm = 0.0311, lr_0 = 9.2101e-04
Validation auc = 0.718948
Epoch 1590
Validation auc = 0.713645
Epoch 1591
Validation auc = 0.707249
Epoch 1592
Validation auc = 0.701400
Epoch 1593
Validation auc = 0.695823
Epoch 1594
Loss = 5.0449e-02, PNorm = 111.5386, GNorm = 2.4728, lr_0 = 9.2080e-04
Validation auc = 0.694238
Epoch 1595
Validation auc = 0.688443
Epoch 1596
Validation auc = 0.685764
Epoch 1597
Validation auc = 0.683031
Epoch 1598
Validation auc = 0.680953
Epoch 1599
Loss = 3.0777e-03, PNorm = 111.6217, GNorm = 0.1400, lr_0 = 9.2055e-04
Validation auc = 0.679915
Epoch 1600
Validation auc = 0.678111
Epoch 1601
Validation auc = 0.679751
Epoch 1602
Validation auc = 0.681773
Epoch 1603
Loss = 6.5693e-04, PNorm = 111.6635, GNorm = 0.0234, lr_0 = 9.2034e-04
Loss = 1.7669e-04, PNorm = 111.6655, GNorm = 0.0070, lr_0 = 9.2032e-04
Validation auc = 0.683578
Epoch 1604
Validation auc = 0.681937
Epoch 1605
Validation auc = 0.691668
Epoch 1606
Validation auc = 0.697737
Epoch 1607
Validation auc = 0.701564
Epoch 1608
Loss = 6.2673e-03, PNorm = 111.6865, GNorm = 0.0993, lr_0 = 9.2010e-04
Validation auc = 0.704789
Epoch 1609
Validation auc = 0.705773
Epoch 1610
Validation auc = 0.706648
Epoch 1611
Validation auc = 0.710475
Epoch 1612
Validation auc = 0.709545
Epoch 1613
Loss = 4.5871e-03, PNorm = 111.7177, GNorm = 0.0625, lr_0 = 9.1987e-04
Validation auc = 0.709162
Epoch 1614
Validation auc = 0.709326
Epoch 1615
Validation auc = 0.706538
Epoch 1616
Validation auc = 0.704789
Epoch 1617
Loss = 2.1676e-02, PNorm = 111.7434, GNorm = 0.4252, lr_0 = 9.1966e-04
Loss = 1.0125e-02, PNorm = 111.7455, GNorm = 0.2197, lr_0 = 9.1964e-04
Validation auc = 0.704516
Epoch 1618
Validation auc = 0.704844
Epoch 1619
Validation auc = 0.702384
Epoch 1620
Validation auc = 0.699978
Epoch 1621
Validation auc = 0.693801
Epoch 1622
Loss = 8.2718e-02, PNorm = 111.7924, GNorm = 3.4394, lr_0 = 9.1941e-04
Loss = 1.8855e-05, PNorm = 111.7959, GNorm = 0.0009, lr_0 = 9.1939e-04
Validation auc = 0.695605
Epoch 1623
Validation auc = 0.697955
Epoch 1624
Validation auc = 0.695003
Epoch 1625
Validation auc = 0.691723
Epoch 1626
Validation auc = 0.691450
Epoch 1627
Loss = 5.2476e-03, PNorm = 111.8571, GNorm = 0.1004, lr_0 = 9.1918e-04
Validation auc = 0.692325
Epoch 1628
Validation auc = 0.685874
Epoch 1629
Validation auc = 0.677181
Epoch 1630
Validation auc = 0.670730
Epoch 1631
Validation auc = 0.665810
Epoch 1632
Loss = 5.6001e-03, PNorm = 111.9905, GNorm = 0.0830, lr_0 = 9.1894e-04
Validation auc = 0.663022
Epoch 1633
Validation auc = 0.662694
Epoch 1634
Validation auc = 0.665045
Epoch 1635
Validation auc = 0.668325
Epoch 1636
Loss = 1.2524e-02, PNorm = 112.1272, GNorm = 0.3319, lr_0 = 9.1873e-04
Loss = 7.5549e-03, PNorm = 112.1370, GNorm = 0.1885, lr_0 = 9.1871e-04
Validation auc = 0.671441
Epoch 1637
Validation auc = 0.669418
Epoch 1638
Validation auc = 0.672316
Epoch 1639
Validation auc = 0.675323
Epoch 1640
Validation auc = 0.677619
Epoch 1641
Loss = 1.8373e-03, PNorm = 112.2594, GNorm = 0.1309, lr_0 = 9.1848e-04
Validation auc = 0.680243
Epoch 1642
Validation auc = 0.680735
Epoch 1643
Validation auc = 0.681227
Epoch 1644
Validation auc = 0.683960
Epoch 1645
Validation auc = 0.687842
Epoch 1646
Loss = 7.7097e-04, PNorm = 112.3483, GNorm = 0.0219, lr_0 = 9.1825e-04
Validation auc = 0.691887
Epoch 1647
Validation auc = 0.694183
Epoch 1648
Validation auc = 0.696151
Epoch 1649
Validation auc = 0.695659
Epoch 1650
Loss = 2.5379e-01, PNorm = 112.4005, GNorm = 1.7823, lr_0 = 9.1804e-04
Loss = 4.1954e-03, PNorm = 112.4041, GNorm = 0.1227, lr_0 = 9.1803e-04
Validation auc = 0.700142
Epoch 1651
Validation auc = 0.702712
Epoch 1652
Validation auc = 0.698393
Epoch 1653
Validation auc = 0.692161
Epoch 1654
Validation auc = 0.690411
Epoch 1655
Loss = 2.0632e-03, PNorm = 112.5082, GNorm = 0.0300, lr_0 = 9.1780e-04
Loss = 8.2067e-03, PNorm = 112.5153, GNorm = 0.1727, lr_0 = 9.1778e-04
Validation auc = 0.692707
Epoch 1656
Validation auc = 0.692489
Epoch 1657
Validation auc = 0.690028
Epoch 1658
Validation auc = 0.687678
Epoch 1659
Validation auc = 0.687514
Epoch 1660
Loss = 1.6468e-03, PNorm = 112.5846, GNorm = 0.0402, lr_0 = 9.1757e-04
Validation auc = 0.687568
Epoch 1661
Validation auc = 0.684343
Epoch 1662
Validation auc = 0.678821
Epoch 1663
Validation auc = 0.677564
Epoch 1664
Validation auc = 0.682867
Epoch 1665
Loss = 7.9074e-02, PNorm = 112.7526, GNorm = 0.9042, lr_0 = 9.1733e-04
Validation auc = 0.681828
Epoch 1666
Validation auc = 0.681008
Epoch 1667
Validation auc = 0.683195
Epoch 1668
Validation auc = 0.685272
Epoch 1669
Loss = 1.9836e-03, PNorm = 112.8711, GNorm = 0.0626, lr_0 = 9.1712e-04
Loss = 1.2120e-06, PNorm = 112.8772, GNorm = 0.0001, lr_0 = 9.1710e-04
Validation auc = 0.688388
Epoch 1670
Validation auc = 0.688334
Epoch 1671
Validation auc = 0.685327
Epoch 1672
Validation auc = 0.681445
Epoch 1673
Validation auc = 0.679368
Epoch 1674
Loss = 1.0563e-02, PNorm = 112.9261, GNorm = 0.4904, lr_0 = 9.1687e-04
Validation auc = 0.679423
Epoch 1675
Validation auc = 0.682703
Epoch 1676
Validation auc = 0.685600
Epoch 1677
Validation auc = 0.687350
Epoch 1678
Validation auc = 0.687514
Epoch 1679
Loss = 2.9323e-03, PNorm = 112.9743, GNorm = 0.0849, lr_0 = 9.1664e-04
Validation auc = 0.688224
Epoch 1680
Validation auc = 0.688443
Epoch 1681
Validation auc = 0.688826
Epoch 1682
Validation auc = 0.689372
Epoch 1683
Loss = 2.5622e-03, PNorm = 113.0053, GNorm = 0.0055, lr_0 = 9.1642e-04
Validation auc = 0.688334
Epoch 1684
Validation auc = 0.686912
Epoch 1685
Validation auc = 0.686639
Epoch 1686
Validation auc = 0.685054
Epoch 1687
Validation auc = 0.684398
Epoch 1688
Loss = 7.1859e-03, PNorm = 113.0515, GNorm = 0.1327, lr_0 = 9.1619e-04
Loss = 5.8555e-04, PNorm = 113.0550, GNorm = 0.0198, lr_0 = 9.1617e-04
Validation auc = 0.684288
Epoch 1689
Validation auc = 0.684671
Epoch 1690
Validation auc = 0.683687
Epoch 1691
Validation auc = 0.682921
Epoch 1692
Validation auc = 0.681664
Epoch 1693
Loss = 1.8091e-04, PNorm = 113.0991, GNorm = 0.0052, lr_0 = 9.1596e-04
Validation auc = 0.681172
Epoch 1694
Validation auc = 0.680844
Epoch 1695
Validation auc = 0.680953
Epoch 1696
Validation auc = 0.678876
Epoch 1697
Validation auc = 0.677564
Epoch 1698
Loss = 2.3479e-04, PNorm = 113.1329, GNorm = 0.0060, lr_0 = 9.1572e-04
Validation auc = 0.677400
Epoch 1699
Validation auc = 0.675651
Epoch 1700
Validation auc = 0.673026
Epoch 1701
Validation auc = 0.674175
Epoch 1702
Loss = 2.1239e-02, PNorm = 113.1750, GNorm = 0.1307, lr_0 = 9.1551e-04
Loss = 1.0538e-02, PNorm = 113.1839, GNorm = 0.3028, lr_0 = 9.1549e-04
Validation auc = 0.679641
Epoch 1703
Validation auc = 0.692981
Epoch 1704
Validation auc = 0.713645
Epoch 1705
Validation auc = 0.713317
Epoch 1706
Validation auc = 0.706921
Epoch 1707
Loss = 6.0864e-03, PNorm = 113.3278, GNorm = 0.1435, lr_0 = 9.1526e-04
Loss = 1.3732e-03, PNorm = 113.3372, GNorm = 0.0699, lr_0 = 9.1525e-04
Validation auc = 0.702821
Epoch 1708
Validation auc = 0.701126
Epoch 1709
Validation auc = 0.700962
Epoch 1710
Validation auc = 0.698065
Epoch 1711
Validation auc = 0.695058
Epoch 1712
Loss = 9.0851e-04, PNorm = 113.4308, GNorm = 0.0218, lr_0 = 9.1504e-04
Validation auc = 0.694511
Epoch 1713
Validation auc = 0.690794
Epoch 1714
Validation auc = 0.688443
Epoch 1715
Validation auc = 0.687568
Epoch 1716
Loss = 1.3497e-03, PNorm = 113.4870, GNorm = 0.0741, lr_0 = 9.1481e-04
Validation auc = 0.686694
Epoch 1717
Validation auc = 0.686420
Epoch 1718
Validation auc = 0.685436
Epoch 1719
Validation auc = 0.684616
Epoch 1720
Validation auc = 0.683796
Epoch 1721
Loss = 3.7523e-04, PNorm = 113.5304, GNorm = 0.0199, lr_0 = 9.1458e-04
Loss = 2.5648e-05, PNorm = 113.5335, GNorm = 0.0018, lr_0 = 9.1457e-04
Validation auc = 0.683632
Epoch 1722
Validation auc = 0.683687
Epoch 1723
Validation auc = 0.684343
Epoch 1724
Validation auc = 0.685218
Epoch 1725
Validation auc = 0.685546
Epoch 1726
Loss = 1.6355e-06, PNorm = 113.5752, GNorm = 0.0001, lr_0 = 9.1436e-04
Validation auc = 0.686038
Epoch 1727
Validation auc = 0.686475
Epoch 1728
Validation auc = 0.686639
Epoch 1729
Validation auc = 0.686475
Epoch 1730
Validation auc = 0.684890
Epoch 1731
Loss = 1.2541e-06, PNorm = 113.6035, GNorm = 0.0001, lr_0 = 9.1411e-04
Validation auc = 0.682320
Epoch 1732
Validation auc = 0.678220
Epoch 1733
Validation auc = 0.674831
Epoch 1734
Validation auc = 0.672972
Epoch 1735
Loss = 1.4858e-03, PNorm = 113.6293, GNorm = 0.0714, lr_0 = 9.1390e-04
Loss = 2.5172e-05, PNorm = 113.6325, GNorm = 0.0015, lr_0 = 9.1389e-04
Validation auc = 0.672589
Epoch 1736
Validation auc = 0.672972
Epoch 1737
Validation auc = 0.673956
Epoch 1738
Validation auc = 0.674065
Epoch 1739
Validation auc = 0.673354
Epoch 1740
Loss = 5.1485e-04, PNorm = 113.6727, GNorm = 0.0216, lr_0 = 9.1366e-04
Loss = 2.7634e-05, PNorm = 113.6760, GNorm = 0.0020, lr_0 = 9.1364e-04
Validation auc = 0.673682
Epoch 1741
Validation auc = 0.673300
Epoch 1742
Validation auc = 0.673573
Epoch 1743
Validation auc = 0.673518
Epoch 1744
Validation auc = 0.673846
Epoch 1745
Loss = 2.8768e-04, PNorm = 113.7072, GNorm = 0.0073, lr_0 = 9.1343e-04
Validation auc = 0.673792
Epoch 1746
Validation auc = 0.674010
Epoch 1747
Validation auc = 0.673901
Epoch 1748
Validation auc = 0.673792
Epoch 1749
Loss = 2.8308e-03, PNorm = 113.7148, GNorm = 0.0002, lr_0 = 9.1320e-04
Validation auc = 0.673409
Epoch 1750
Validation auc = 0.673300
Epoch 1751
Validation auc = 0.673026
Epoch 1752
Validation auc = 0.673409
Epoch 1753
Validation auc = 0.673245
Epoch 1754
Loss = 6.6964e-04, PNorm = 113.7283, GNorm = 0.0109, lr_0 = 9.1298e-04
Loss = 9.9030e-04, PNorm = 113.7296, GNorm = 0.0266, lr_0 = 9.1296e-04
Validation auc = 0.673354
Epoch 1755
Validation auc = 0.672917
Epoch 1756
Validation auc = 0.672425
Epoch 1757
Validation auc = 0.672261
Epoch 1758
Validation auc = 0.672370
Epoch 1759
Loss = 5.4919e-04, PNorm = 113.7479, GNorm = 0.0123, lr_0 = 9.1275e-04
Validation auc = 0.672097
Epoch 1760
Validation auc = 0.671933
Epoch 1761
Validation auc = 0.671769
Epoch 1762
Validation auc = 0.672316
Epoch 1763
Validation auc = 0.672097
Epoch 1764
Loss = 5.9403e-04, PNorm = 113.7772, GNorm = 0.0165, lr_0 = 9.1251e-04
Validation auc = 0.672316
Epoch 1765
Validation auc = 0.672972
Epoch 1766
Validation auc = 0.674284
Epoch 1767
Validation auc = 0.676580
Epoch 1768
Loss = 3.0909e-03, PNorm = 113.8057, GNorm = 0.0486, lr_0 = 9.1230e-04
Loss = 6.4372e-06, PNorm = 113.8073, GNorm = 0.0003, lr_0 = 9.1228e-04
Validation auc = 0.678329
Epoch 1769
Validation auc = 0.678657
Epoch 1770
Validation auc = 0.679149
Epoch 1771
Validation auc = 0.679477
Epoch 1772
Validation auc = 0.679532
Epoch 1773
Loss = 1.7291e-03, PNorm = 113.8335, GNorm = 0.3785, lr_0 = 9.1206e-04
Loss = 5.8188e-05, PNorm = 113.8352, GNorm = 0.0022, lr_0 = 9.1204e-04
Validation auc = 0.679860
Epoch 1774
Validation auc = 0.679696
Epoch 1775
Validation auc = 0.679860
Epoch 1776
Validation auc = 0.680188
Epoch 1777
Validation auc = 0.680735
Epoch 1778
Loss = 1.0334e-04, PNorm = 113.8554, GNorm = 0.0033, lr_0 = 9.1183e-04
Validation auc = 0.680680
Epoch 1779
Validation auc = 0.681336
Epoch 1780
Validation auc = 0.682211
Epoch 1781
Validation auc = 0.682921
Epoch 1782
Validation auc = 0.682320
Epoch 1783
Loss = 1.6715e-03, PNorm = 113.8766, GNorm = 0.0375, lr_0 = 9.1159e-04
Validation auc = 0.681828
Epoch 1784
Validation auc = 0.681773
Epoch 1785
Validation auc = 0.681828
Epoch 1786
Validation auc = 0.682101
Epoch 1787
Loss = 3.2279e-04, PNorm = 113.9000, GNorm = 0.0190, lr_0 = 9.1138e-04
Loss = 6.3825e-05, PNorm = 113.9013, GNorm = 0.0043, lr_0 = 9.1136e-04
Validation auc = 0.681500
Epoch 1788
Validation auc = 0.681281
Epoch 1789
Validation auc = 0.681008
Epoch 1790
Validation auc = 0.680735
Epoch 1791
Validation auc = 0.680789
Epoch 1792
Loss = 5.7154e-05, PNorm = 113.9126, GNorm = 0.0020, lr_0 = 9.1115e-04
Validation auc = 0.680899
Epoch 1793
Validation auc = 0.680899
Epoch 1794
Validation auc = 0.680953
Epoch 1795
Validation auc = 0.681063
Epoch 1796
Validation auc = 0.680953
Epoch 1797
Loss = 2.1707e-04, PNorm = 113.9192, GNorm = 0.0075, lr_0 = 9.1091e-04
Validation auc = 0.680789
Epoch 1798
Validation auc = 0.680789
Epoch 1799
Validation auc = 0.680789
Epoch 1800
Validation auc = 0.680625
Epoch 1801
Loss = 5.6864e-05, PNorm = 113.9236, GNorm = 0.0029, lr_0 = 9.1070e-04
Loss = 2.1458e-06, PNorm = 113.9238, GNorm = 0.0002, lr_0 = 9.1068e-04
Validation auc = 0.680789
Epoch 1802
Validation auc = 0.680844
Epoch 1803
Validation auc = 0.681063
Epoch 1804
Validation auc = 0.674393
Epoch 1805
Validation auc = 0.664416
Epoch 1806
Loss = 1.3087e-02, PNorm = 113.9580, GNorm = 0.3874, lr_0 = 9.1046e-04
Loss = 1.7285e-06, PNorm = 113.9631, GNorm = 0.0001, lr_0 = 9.1044e-04
Validation auc = 0.664826
Epoch 1807
Validation auc = 0.677564
Epoch 1808
Validation auc = 0.684944
Epoch 1809
Validation auc = 0.690630
Epoch 1810
Validation auc = 0.695550
Epoch 1811
Loss = 3.7936e-04, PNorm = 114.0259, GNorm = 0.0283, lr_0 = 9.1023e-04
Validation auc = 0.698338
Epoch 1812
Validation auc = 0.703586
Epoch 1813
Validation auc = 0.705882
Epoch 1814
Validation auc = 0.706757
Epoch 1815
Validation auc = 0.708397
Epoch 1816
Loss = 2.1222e-03, PNorm = 114.0789, GNorm = 0.1302, lr_0 = 9.0999e-04
Validation auc = 0.710201
Epoch 1817
Validation auc = 0.711404
Epoch 1818
Validation auc = 0.711732
Epoch 1819
Validation auc = 0.712388
Epoch 1820
Loss = 1.7269e-04, PNorm = 114.1124, GNorm = 0.0024, lr_0 = 9.0978e-04
Loss = 4.1719e-05, PNorm = 114.1143, GNorm = 0.0022, lr_0 = 9.0976e-04
Validation auc = 0.713973
Epoch 1821
Validation auc = 0.714192
Epoch 1822
Validation auc = 0.713864
Epoch 1823
Validation auc = 0.713973
Epoch 1824
Validation auc = 0.713809
Epoch 1825
Loss = 4.3667e-04, PNorm = 114.1354, GNorm = 0.0128, lr_0 = 9.0955e-04
Validation auc = 0.713809
Epoch 1826
Validation auc = 0.715067
Epoch 1827
Validation auc = 0.716105
Epoch 1828
Validation auc = 0.716761
Epoch 1829
Validation auc = 0.717800
Epoch 1830
Loss = 1.3891e-03, PNorm = 114.1573, GNorm = 0.0575, lr_0 = 9.0931e-04
Validation auc = 0.718347
Epoch 1831
Validation auc = 0.718948
Epoch 1832
Validation auc = 0.718948
Epoch 1833
Validation auc = 0.719222
Epoch 1834
Loss = 2.9757e-02, PNorm = 114.1759, GNorm = 0.0032, lr_0 = 9.0910e-04
Loss = 6.9862e-05, PNorm = 114.1785, GNorm = 0.0038, lr_0 = 9.0909e-04
Validation auc = 0.720151
Epoch 1835
Validation auc = 0.722830
Epoch 1836
Validation auc = 0.723431
Epoch 1837
Validation auc = 0.723650
Epoch 1838
Validation auc = 0.723322
Epoch 1839
Loss = 4.4056e-03, PNorm = 114.2258, GNorm = 0.8105, lr_0 = 9.0886e-04
Loss = 5.2129e-03, PNorm = 114.2308, GNorm = 0.3470, lr_0 = 9.0884e-04
Validation auc = 0.723923
Epoch 1840
Validation auc = 0.724251
Epoch 1841
Validation auc = 0.722392
Epoch 1842
Validation auc = 0.721408
Epoch 1843
Validation auc = 0.723814
Epoch 1844
Loss = 1.7458e-04, PNorm = 114.2575, GNorm = 0.0048, lr_0 = 9.0863e-04
Validation auc = 0.726000
Epoch 1845
Validation auc = 0.727312
Epoch 1846
Validation auc = 0.723704
Epoch 1847
Validation auc = 0.722010
Epoch 1848
Validation auc = 0.722392
Epoch 1849
Loss = 4.0337e-03, PNorm = 114.2960, GNorm = 0.0625, lr_0 = 9.0839e-04
Validation auc = 0.722884
Epoch 1850
Validation auc = 0.723322
Epoch 1851
Validation auc = 0.722720
Epoch 1852
Validation auc = 0.722939
Epoch 1853
Loss = 2.6010e-03, PNorm = 114.3243, GNorm = 0.1297, lr_0 = 9.0818e-04
Loss = 1.1921e-05, PNorm = 114.3263, GNorm = 0.0010, lr_0 = 9.0817e-04
Validation auc = 0.723376
Epoch 1854
Validation auc = 0.724087
Epoch 1855
Validation auc = 0.725126
Epoch 1856
Validation auc = 0.725891
Epoch 1857
Validation auc = 0.727258
Epoch 1858
Loss = 5.2022e-04, PNorm = 114.3483, GNorm = 0.0060, lr_0 = 9.0794e-04
Validation auc = 0.728242
Epoch 1859
Validation auc = 0.729171
Epoch 1860
Validation auc = 0.729609
Epoch 1861
Validation auc = 0.729937
Epoch 1862
Validation auc = 0.730155
Epoch 1863
Loss = 4.7672e-04, PNorm = 114.3650, GNorm = 0.0086, lr_0 = 9.0772e-04
Validation auc = 0.730593
Epoch 1864
Validation auc = 0.730702
Epoch 1865
Validation auc = 0.730921
Epoch 1866
Validation auc = 0.730374
Epoch 1867
Loss = 7.6756e-02, PNorm = 114.3767, GNorm = 1.0440, lr_0 = 9.0751e-04
Loss = 5.0266e-06, PNorm = 114.3763, GNorm = 0.0004, lr_0 = 9.0749e-04
Validation auc = 0.728953
Epoch 1868
Validation auc = 0.727367
Epoch 1869
Validation auc = 0.726492
Epoch 1870
Validation auc = 0.726055
Epoch 1871
Validation auc = 0.725891
Epoch 1872
Loss = 1.3164e-03, PNorm = 114.3870, GNorm = 0.0045, lr_0 = 9.0727e-04
Loss = 5.5386e-05, PNorm = 114.3881, GNorm = 0.0052, lr_0 = 9.0725e-04
Validation auc = 0.726219
Epoch 1873
Validation auc = 0.726984
Epoch 1874
Validation auc = 0.730374
Epoch 1875
Validation auc = 0.732725
Epoch 1876
Validation auc = 0.734310
Epoch 1877
Loss = 7.7143e-05, PNorm = 114.4030, GNorm = 0.0033, lr_0 = 9.0704e-04
Validation auc = 0.735185
Epoch 1878
Validation auc = 0.736114
Epoch 1879
Validation auc = 0.736770
Epoch 1880
Validation auc = 0.736934
Epoch 1881
Validation auc = 0.737645
Epoch 1882
Loss = 8.5184e-02, PNorm = 114.4169, GNorm = 0.4150, lr_0 = 9.0680e-04
Validation auc = 0.737590
Epoch 1883
Validation auc = 0.734419
Epoch 1884
Validation auc = 0.731577
Epoch 1885
Validation auc = 0.729445
Epoch 1886
Loss = 1.6771e-02, PNorm = 114.4756, GNorm = 0.3220, lr_0 = 9.0659e-04
Loss = 3.5534e-04, PNorm = 114.4858, GNorm = 0.0160, lr_0 = 9.0657e-04
Validation auc = 0.737645
Epoch 1887
Validation auc = 0.742128
Epoch 1888
Validation auc = 0.743713
Epoch 1889
Validation auc = 0.744041
Epoch 1890
Validation auc = 0.744697
Epoch 1891
Loss = 2.2885e-02, PNorm = 114.6099, GNorm = 1.2999, lr_0 = 9.0635e-04
Validation auc = 0.744970
Epoch 1892
Validation auc = 0.745134
Epoch 1893
Validation auc = 0.744424
Epoch 1894
Validation auc = 0.745791
Epoch 1895
Validation auc = 0.741526
Epoch 1896
Loss = 1.4466e-01, PNorm = 114.7103, GNorm = 1.1040, lr_0 = 9.0612e-04
Validation auc = 0.741964
Epoch 1897
Validation auc = 0.754702
Epoch 1898
Validation auc = 0.758583
Epoch 1899
Validation auc = 0.753881
Epoch 1900
Loss = 8.0114e-02, PNorm = 114.9585, GNorm = 1.1995, lr_0 = 9.0592e-04
Loss = 4.3140e-02, PNorm = 114.9733, GNorm = 1.6419, lr_0 = 9.0590e-04
Validation auc = 0.744697
Epoch 1901
Validation auc = 0.742784
Epoch 1902
Validation auc = 0.741417
Epoch 1903
Validation auc = 0.738356
Epoch 1904
Validation auc = 0.736661
Epoch 1905
Loss = 8.2365e-03, PNorm = 115.1948, GNorm = 0.2544, lr_0 = 9.0567e-04
Loss = 4.8416e-03, PNorm = 115.2100, GNorm = 0.2559, lr_0 = 9.0566e-04
Validation auc = 0.733490
Epoch 1906
Validation auc = 0.729609
Epoch 1907
Validation auc = 0.725235
Epoch 1908
Validation auc = 0.721135
Epoch 1909
Validation auc = 0.714903
Epoch 1910
Loss = 3.9761e-03, PNorm = 115.3884, GNorm = 0.1423, lr_0 = 9.0545e-04
Validation auc = 0.711568
Epoch 1911
Validation auc = 0.708670
Epoch 1912
Validation auc = 0.709326
Epoch 1913
Validation auc = 0.711841
Epoch 1914
Validation auc = 0.713099
Epoch 1915
Loss = 3.4418e-03, PNorm = 115.5088, GNorm = 0.2446, lr_0 = 9.0521e-04
Validation auc = 0.712607
Epoch 1916
Validation auc = 0.712607
Epoch 1917
Validation auc = 0.711513
Epoch 1918
Validation auc = 0.710693
Epoch 1919
Loss = 1.5716e-03, PNorm = 115.5591, GNorm = 0.0054, lr_0 = 9.0500e-04
Loss = 1.0542e-03, PNorm = 115.5617, GNorm = 0.0727, lr_0 = 9.0498e-04
Validation auc = 0.710475
Epoch 1920
Validation auc = 0.711623
Epoch 1921
Validation auc = 0.711185
Epoch 1922
Validation auc = 0.711677
Epoch 1923
Validation auc = 0.711623
Epoch 1924
Loss = 3.4976e-04, PNorm = 115.5901, GNorm = 0.0190, lr_0 = 9.0476e-04
Validation auc = 0.711732
Epoch 1925
Validation auc = 0.712060
Epoch 1926
Validation auc = 0.712333
Epoch 1927
Validation auc = 0.712279
Epoch 1928
Validation auc = 0.712224
Epoch 1929
Loss = 7.4954e-05, PNorm = 115.6068, GNorm = 0.0032, lr_0 = 9.0454e-04
Validation auc = 0.711951
Epoch 1930
Validation auc = 0.711841
Epoch 1931
Validation auc = 0.711459
Epoch 1932
Validation auc = 0.711076
Epoch 1933
Loss = 2.3988e-04, PNorm = 115.6190, GNorm = 0.0127, lr_0 = 9.0431e-04
Validation auc = 0.711021
Epoch 1934
Validation auc = 0.710967
Epoch 1935
Validation auc = 0.710857
Epoch 1936
Validation auc = 0.711021
Epoch 1937
Validation auc = 0.708616
Epoch 1938
Loss = 1.1464e-04, PNorm = 115.6295, GNorm = 0.0064, lr_0 = 9.0409e-04
Loss = 1.7787e-04, PNorm = 115.6306, GNorm = 0.0085, lr_0 = 9.0407e-04
Validation auc = 0.705226
Epoch 1939
Validation auc = 0.702930
Epoch 1940
Validation auc = 0.703750
Epoch 1941
Validation auc = 0.704242
Epoch 1942
Validation auc = 0.704242
Epoch 1943
Loss = 1.0201e-03, PNorm = 115.6554, GNorm = 0.0190, lr_0 = 9.0386e-04
Validation auc = 0.704297
Epoch 1944
Validation auc = 0.704570
Epoch 1945
Validation auc = 0.705226
Epoch 1946
Validation auc = 0.705992
Epoch 1947
Validation auc = 0.706156
Epoch 1948
Loss = 2.0918e-03, PNorm = 115.6885, GNorm = 0.2131, lr_0 = 9.0362e-04
Validation auc = 0.706101
Epoch 1949
Validation auc = 0.707249
Epoch 1950
Validation auc = 0.706757
Epoch 1951
Validation auc = 0.706101
Epoch 1952
Loss = 1.4520e-04, PNorm = 115.7147, GNorm = 0.0055, lr_0 = 9.0341e-04
Loss = 4.9670e-06, PNorm = 115.7167, GNorm = 0.0003, lr_0 = 9.0340e-04
Validation auc = 0.706046
Epoch 1953
Validation auc = 0.706265
Epoch 1954
Validation auc = 0.706538
Epoch 1955
Validation auc = 0.706866
Epoch 1956
Validation auc = 0.707358
Epoch 1957
Loss = 5.3805e-05, PNorm = 115.7355, GNorm = 0.0026, lr_0 = 9.0317e-04
Loss = 1.3636e-04, PNorm = 115.7364, GNorm = 0.0084, lr_0 = 9.0316e-04
Validation auc = 0.707686
Epoch 1958
Validation auc = 0.707413
Epoch 1959
Validation auc = 0.707741
Epoch 1960
Validation auc = 0.707796
Epoch 1961
Validation auc = 0.707632
Epoch 1962
Loss = 1.3680e-05, PNorm = 115.7478, GNorm = 0.0006, lr_0 = 9.0295e-04
Validation auc = 0.708014
Epoch 1963
Validation auc = 0.698393
Epoch 1964
Validation auc = 0.714684
Epoch 1965
Validation auc = 0.727476
Epoch 1966
Loss = 1.4827e-03, PNorm = 115.7619, GNorm = 0.2291, lr_0 = 9.0273e-04
Validation auc = 0.736114
Epoch 1967
Validation auc = 0.738356
Epoch 1968
Validation auc = 0.739941
Epoch 1969
Validation auc = 0.741526
Epoch 1970
Validation auc = 0.742784
Epoch 1971
Loss = 1.0895e-02, PNorm = 115.8346, GNorm = 2.4901, lr_0 = 9.0250e-04
Loss = 1.8638e-03, PNorm = 115.8391, GNorm = 0.0789, lr_0 = 9.0249e-04
Validation auc = 0.742018
Epoch 1972
Validation auc = 0.739722
Epoch 1973
Validation auc = 0.738793
Epoch 1974
Validation auc = 0.739066
Epoch 1975
Validation auc = 0.740214
Epoch 1976
Loss = 1.3042e-03, PNorm = 115.9091, GNorm = 0.0283, lr_0 = 9.0228e-04
Validation auc = 0.737645
Epoch 1977
Validation auc = 0.736989
Epoch 1978
Validation auc = 0.734857
Epoch 1979
Validation auc = 0.735185
Epoch 1980
Validation auc = 0.734419
Epoch 1981
Loss = 3.2514e-03, PNorm = 115.9876, GNorm = 0.0517, lr_0 = 9.0204e-04
Validation auc = 0.734091
Epoch 1982
Validation auc = 0.733545
Epoch 1983
Validation auc = 0.736387
Epoch 1984
Validation auc = 0.740378
Epoch 1985
Loss = 4.9681e-04, PNorm = 116.0303, GNorm = 0.0224, lr_0 = 9.0183e-04
Loss = 4.9098e-02, PNorm = 116.0356, GNorm = 6.6501, lr_0 = 9.0181e-04
Validation auc = 0.739449
Epoch 1986
Validation auc = 0.735513
Epoch 1987
Validation auc = 0.730811
Epoch 1988
Validation auc = 0.726602
Epoch 1989
Validation auc = 0.722994
Epoch 1990
Loss = 6.2361e-03, PNorm = 116.1114, GNorm = 1.2052, lr_0 = 9.0159e-04
Loss = 7.6709e-04, PNorm = 116.1166, GNorm = 0.0311, lr_0 = 9.0157e-04
Validation auc = 0.721299
Epoch 1991
Validation auc = 0.719878
Epoch 1992
Validation auc = 0.715340
Epoch 1993
Validation auc = 0.711459
Epoch 1994
Validation auc = 0.707741
Epoch 1995
Loss = 1.2832e-01, PNorm = 116.1966, GNorm = 1.9301, lr_0 = 9.0137e-04
Validation auc = 0.709654
Epoch 1996
Validation auc = 0.713700
Epoch 1997
Validation auc = 0.716379
Epoch 1998
Validation auc = 0.719222
Epoch 1999
Loss = 1.0767e-04, PNorm = 116.2720, GNorm = 0.0141, lr_0 = 9.0114e-04
Validation auc = 0.718839
Model 0 best validation auc = 0.784387 on epoch 1379
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.608329
Ensemble test auc = 0.608329
10-fold cross validation
	Seed 0 ==> test auc = 0.618687
	Seed 1 ==> test auc = 0.644667
	Seed 2 ==> test auc = 0.571777
	Seed 3 ==> test auc = 0.638760
	Seed 4 ==> test auc = 0.585859
	Seed 5 ==> test auc = 0.672188
	Seed 6 ==> test auc = 0.701207
	Seed 7 ==> test auc = 0.614835
	Seed 8 ==> test auc = 0.579695
	Seed 9 ==> test auc = 0.608329
Overall test auc = 0.623600 +/- 0.039280
Elapsed time = 3:40:16
